ROME  LABORATORY 
RELIABILITY 

ENGINEER'S  TOOLKIT 


□  □ 


QUICK  REFERENCE 


Quick  Reference  AppHceUon  Index 

How  Do  I ...  ? 

•  Understand  the  Principles  of  TQM .  2 

•  Understand  Basic  DoD  R&M  Policy  and  Procedures .  7 

•  Deveiop  Quantitative  Requirements 

Reliability  (R) .  11 

Maintainability  (M) .  17 

Testability  (T) .  20 

•  Tailor  R4M  Task  Requirements .  23 

•  R&M  Task  Application/Priorities .  25 

•  Develop  a  Contract  Data  Requirements  List .  26 

•  Specify  information  To  Be  Included  in  Proposals .  28 

•  Evaluate  Contractor  Proposals .  31 

•  Specify  Part  Stress  Derating .  37 

•  Determine  the  Limitations  of  Common  Cooling  Techniques .  44 

•  Understand  Basic  Parts  Control .  46 

•  Identify  Key  R&M&T  Topics  for  Evaluation  at  Design  Reviews .  55 

•  Evaluate  Contactor's  Method  of  Managing  Critical  Items .  62 

•  Understand  Design  Concerns  Associated  with  Dormant  Conditions .  63 

•  Understand  Basic  SMT  Design  Issues .  66 

•  Evaluate  Power  Supply  Reliability .  67 

•  Determine  Part  Failure  Modes  and  Mechanisms .  69 

•  Evaluate  Fiber  Optic  Reliability .  73 

•  Understand  R&M&T  Analysis  Types  and  Purposes .  77 

•  Understand  Reliability  Prediction  Methods .  80 

•  Understand  Maintainability  Prediction  Methods .  81 

•  Understand  Testability  Analysis  Methods .  84 

•  Evaluate  a  Reliability  Prediction  Report .  85 

•  Evaluate  Existing  Reliabiiity  Data .  86 

•  Evaluate  a  Maintainability/Testability  Analysis  Report .  87 

•  Evaluate  a  Failure  Modes,  Effects  and  Criticality  Analyses  Report .  88 

>  Approximate  the  Reliability  of  Redundant  Configurations .  89 

•  Perform  a  Quick  (Parts  Count)  Reliability  Prediction .  92 

•  Adjust  Reliability  Data  for  Different  Conditions . 105 

•  Predict  the  Reliability  of  SMT  Designs . 108 

•  Understand  Finite  Element  Analysis  Application . 1 13 

•  Estimate  1C  Junction  Temperatures  for  Common  Cooiing  Techniques . 115 

•  Understand  Sneak  Circuit  Analysis  Appiication . 119 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


QUICK  REFERENCE 


•  Estimate  Reliability  for  Dormant  Conditions . 122 

•  Estimate  Software  Reliability . 124 

•  Develop  an  Environmental  Stress  Screening  (ESS)  Program .  129 

•  Select  a  Reliability  Qualification  Test . 134 

•  Select  a  Maintainability  Qualification  Test . 136 

•  Select  a  Testability  Demonstration  Test . 137 

•  Evaluate  a  Failure  Reporting  and  Corrective  Action  System . 138 

•  Evaluate  a  Reliability  Demonstration  Test  Plan . 140 

•  Evaluate  a  Reliability  Demonstration  Test  Procedure . 144 

•  Evaluate  a  Maintainability  Test  Plan  and  Procedure . 145 

•  Participate  in  R&M  Testing . 146 

•  Evaluate  R&M  Demonstration  Test  Reports . 147 

•  Understand  Basic  Design  of  Experiments  Concepts . 148 

•  Understand  Basic  Accelerated  Life  Testing  Concepts . 153 

•  Become  Aware  of  Time  Stress  Measure  Devices . 159 


For  Moro  Help  AppendICM 

How  Do  I ...  ? 


•  Translate  User  Needs  to  R&M  Requirements .  A*1 

•  Develop  SOW  and  Specification  Requirements  (Example) .  A-7 

•  Become  Aware  of  Available  R&M  Software  Tools .  A-1 7 

•  Develop  Design  Guidelines  (Example) .  A-23 

•  Select  a  MIL-HDBK-781  Test  Plan .  A-37 

•  Calculate  Confidence  Intervals .  A-43 

•  Calculate  the  Probability  of  Failure  Occurrence .  A-46 

•  Understand  Reliability  Growth  Testing .  A-51 

•  Select  a  MIL-STD-471  Test  Plan .  A-61 

•  Find  More  R&M  Data .  A-67 

•  Find  R&M  Related  Electronic  Bulletin  Boards .  A-72 

•  Obtain  R&M  Training .  A-75 

•  Obtain  R&M  Periodicals .  A-76 

•  Become  Aware  of  R&M  Symposia  and  Workshops .  A-76 

•  Become  Aware  of  R&M  Specifications,  Standards,  Handbooks  and 

Rome  Laboratory  Technical  Reports .  A-81 

•  Understand  Common  Acronyms .  A-95 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


FOREWORD 


F 


OREWORD 


The  original  RADC  (now  Rome  Laboratory)  Reliability  Engineer's  Toolkit,  July 
1988,  proved  to  be  a  best  seller  among  military,  industry  and  academic 
reliability  practitioners.  Over  10,000  copies  were  distributed  and  the  Toolkit 
and  its  authors  received  the  1989  Federal  Laboratory  Consortium  Special 
Award  for  Excellence  in  Technology  Transfer. 

This  updated  version,  completed  in-house  at  the  Systems  Reliability  Division, 
contains  new  topics  on  accelerated  testing,  thermal  analysis,  surface  mount 
technology,  design  of  experiments,  hardware/software  reliability,  component 
failure  modes/mechanisms,  dormancy,  and  sneak  analysis.  Revisions  and 
updates  in  most  other  areas  were  also  made. 

This  revision  was  led  by  a  project  team  consisting  of  Bmce  Dudley,  Seymour 
Morris,  Dan  Richard  and  myself.  We  acknowledge  the  fine  support  we 
received  from  technical  contributors  Frank  Born,  Tim  Donovan,  Barry 
McKinney,  George  Lyne,  Bill  Bocchi,  Qretchen  Bivens,  Doug  Holzhauer,  Ed 
DePalma,  Joe  Carole,  Rich  Hyle,  Tom  Fennell,  Duane  Gilmour,  Joyce  Jecen, 
Jim  Ryan,  Dr.  Roy  Stratton,  Dr.  Warren  Debany,  Dan  Fayette,  and  Chuck 
Messenger.  We  also  thank  typists  Elaine  Baker  and  Wendy  Stoquert  and  the 
Reliability  Analysis  Center's  Macintosh  Whiz,  Jeanne  Crowell. 

Your  comments  are  always  welcome,  if  you  wish  to  throw  bouquets,  these 
people  should  receive  them.  If  it's  bricks  you're  heaving,  aim  them  at  Bruce, 
Seymour,  or  me  at  the  address  below. 


Anthony  J.  Feduccia 
Rome  Laboratory/ERS 
525  Brooks  Road 
Griffiss  AFB,  NY  13441-4505 
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introdtiction 

Purpose 

This  Toolkit  is  intended  for  use  by  a  practicing  reliability  and  maintainability  (R&M) 
engineer.  Emphasis  is  placed  on  his  or  her  role  in  the  various  R&M  activities  of  an 
electronic  systems  development  program.  The  Toolkit  is  not  intended  to  be  a 
complete  tutorial  or  technical  treatment  c .  the  R&M  discipline  but  rather  a 
compendium  of  useful  R&M  reference  information  to  be  used  in  everyday  practice. 

Format 

The  format  of  the  Toolkit  has  been  designed  for  easy  reference.  Five  main  sections 
are  laid  out  to  follow  the  normal  time  sequence  of  a  military  development  program. 

Descriptions  of  the  "how  to”  of  the  R&M  engineer's  activities  have  been  designed  to 
take  the  form  of  figures,  tables,  and  step-by-step  procedures  as  opposed  to 
paragraphs  of  text.  Appendices  are  included  to  give  a  greater  depth  of  technical 
coverage  to  some  of  the  topics  as  welt  as  to  present  additional  useful  reference 
information. 

The  Toolkit  also  includes  a  ”Quick  Reference  Application  Index"  which  can  be  used 
to  quickly  refer  the  R&M  engineer  to  the  portion  of  a  section  that  answers  specific 
questions.  A  quick  reference  "For  More  Help  Appendices"  index  is  also  included  for 
the  more  in-depth  topics  of  the  appendices. 

Ordering  information  for  the  military  documents  and  reports  listed  in  the  Toolkit  is 
located  in  Appendix  10. 

Terminology 

The  term  "Reliability"  used  in  the  title  of  this  document  is  used  in  the  broad  sense  to 
include  the  field  of  maintainability.  The  content  of  the  report  addresses  reliability 
and  maintainability  (R&M)  because  they  are  usually  the  responsibility  of  one 
government  individual  in  a  military  electronics  development  program.  In  this 
context,  testability  is  considered  as  a  part  of  maintainability  and  is,  therefore, 
inherently  part  of  the  "M"  of  "R&M."  Where  testability  issues,  such  as  development 
of  quantitative  requirements,  are  appropriate  for  separation  from  "M"  discussion, 
they  are  and  have  been  labeled  accordingly. 

Underlying  Philosophy 

The  development  and  application  of  a  successful  reliability  program  requires  a 
number  of  tasks  and  coordination  steps.  Key  ingredients  include: 

•  Aggressive  Program  Manager  Support  •  Thorough  Technical  Reviews 

•  Firm  and  Realistic  Requirements  •  Complete  Verification 

•  Effective  Built-in-Test  •  Parts  Control 

•  Failure  Reporting  &  Corrective  Action 
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Total  Quality  Management 

Total  Quality  Management  (TQM)  is  an  approach  which  puts  quality  first  as  the 
means  to  long-term  survival  and  growth.  It  employs  teamwork  to  improve  the 
processes  used  by  an  organization  in  providing  products  and  senrices.  One  could 
argue  that  TQM  encompasses  Reliability  Engineering  or  that  Reliability  Engineering 
encompasses  many  TQM  activities.  Either  way,  the  reliability  engineer  may  well 
get  involved  in  TQM.  For  example,  he/she  may  be  asked  to  evaluate  a  contractor's 
TQM  approach,  assist  process  improvement  teams  with  statistical  analyses,  or 
serve  as  a  rrrember  of  a  process  improvement  team  looking  at  his/her  own  agency’s 
processes.  It,  therefore,  behooves  the  reliability  professional  to  have  some 
knowledge  of  TQM. 

Principles  of  TQM 

•  Management  Leadership:  For  successful  TQM,  the  company  management 
must  create  a  cultural  change  from  authoritarian  management  focused  on 
short-term  goals  to  using  the  full  potential  of  all  employees  for  long-term 
benefit.  This  means  the  agency  executives  must  be  consistent,  persistent 
and  personally  involved  in  the  pursuit  of  quality. 

•  Focus  on  Customer:  It  is  easy  to  appreciate  the  need  to  focus  on  the 
external  customer.  Less  obvious  is  the  concept  of  internal  customer 
satisfaction.  Reliability  engineering,  for  example,  may  be  asked  by  Design 
Engineering  (the  customer)  to  review  a  proposed  design  for  reliability.  If  an 
incomplete  or  shoddy  evaluation  is  done,  the  ultimate  design  may  not  meet 
specifications.  Output  suffers  and  so  does  the  efficiency  of  the  project  team. 
A  TQM  oriented  organization  seeks  to  understand  and  delight  its  customers, 
both  external  and  internal. 

•  Constant  Improvement:  It  is  estimated  that  about  25%  of  operating  costs  of 
a  typical  manufacturing  agency  go  for  rework  and  scrap.  Service 
organizations  pay  an  even  higher  penalty  for  not  doing  things  right  the  first 
time.  Reducing  these  costs  is  a  potential  source  of  vast  profit.  Hence,  TQM 
agencies  seek  to  constantly  improve  their  processes.  The  usual  change 
agent  is  a  team  with  members  from  all  offices  involved  in  the  process,  and 
including  those  who  actually  perform  the  work.  Besides  the  measurable 
benefits,  process  improvements  mean  fewer  defects  going  to  customers,  with 
an  unmeasurable  but  significant  effect  on  the  bottom  line. 

•  Use  of  Measurements  and  Data:  TQM  agencies  seek  to  measure  quality 
so  that  improvements  can  be  tracked.  Every  process  will  have  some 
operational  definition  of  quality.  The  overall  agency  progress  can  be 
measured  by  calculating  the  "cost  of  quality"  (money  spent  for  preventing 
defects,  appraising  quality,  rework  and  scrap).  Typically,  as  more  money  is 
spent  on  preventing  defects,  savings  made  in  scrap  and  rework  reduce  the 
overall  cost  of  quality.  Another  common  approach  is  to  score  the  agency 
using  the  criteria  for  the  Malcolm  Baldrige  National  Quality  Award  as  a 
measure.  For  Government  agencies,  the  scoring  criteria  for  the  Qffice  of 
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Management  and  Budget  (OMB)  Ouality  Improvement  Prototype  Award  is 
used  in  lieu  of  the  Malcolm  Baldrige  criteria.  R&M  engineers  should  use 
Statistical  Process  Control.  Statistical  Design  of  Experiments,  Ouality 
Function  Deployment,  Taguchi  Methods,  and  other  available  quality  tools. 
Design  of  Experiments  is  explained  in  Topic  T1 4.  Statistical  Process  Control 
techniques  are  described  in  this  topic. 

•  Employee  Involvement;  A  TQM  agency  recognizes  the  value  of  a  skilled 
work  force  cooperating  to  satisfy  the  customer.  Extensive  education  and 
training  programs  exist.  Training  in  job  skills,  quality  methods,  and  team 
building  techniques  is  widely  available.  Cooperation  between  offices  is  the 
norm  (e.g.  concurrent  engineering).  Employees  on  all  levels  are  widely 
involved  in  process  improvement  teams.  Management  looks  for  ways  of 
reducing  the  hassle  created  by  bureaucratic  rules  and  regulations. 
Employees  are  trusted  and  empowered  to  do  their  jobs. 

•  Results:  In  a  TQM  agency,  improvement  is  continuous  and  measured. 
Image  building  measurements  like  the  number  of  improvement  teams  formed, 
are  of  less  value  than  measures  of  cost  of  quality  or  increase  in  production 
whici.  w  real  results.  Management  is  not  concerned  with  filling  squares, 
but  with  making  worthwhile  changes. 

TQM  Tools 

•  Process  Flow  Chart:  A  diagram  showing  all  the  major  steps  of  a  process. 
The  diagram  also  shows  how  the  various  steps  in  the  process  relate  to  each 
other. 


Input 
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•  Par«lo  Chart:  A  bar  graph  of  identified  causes  shown  in  descending  order  of 
frequency  used  to  prioritize  problems  and/or  data.  The  Pareto  Principle 
states  that  a  few  causes  typically  account  for  most  problems  (20%  of  the 
serial  numbered  units  account  for  80%  of  the  failures;  20%  of  the  people  do 
80%  of  the  work;  etc.)  Pareto  d  agrams  help  analyze  operational  data  and 
determine  modes  of  failure,  'hey  are  especially  useful  when  plotted  before 
and  after  an  improvemp'-*  project  or  redesign  to  show  what  progress  has 
been  made. 


100% 


50% 
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•  Fishbone  Chart:  A  cause  and  effect  diagram  for  analyzing  problems  and  the 
factors  that  contribute  to  them,  or,  for  analyzing  the  factors  that  result  in  a 
desired  goal.  Also  called  an  Ishikawa  Chart.  This  tool  requires  the  listing  of 
all  possible  factors  contributing  to  a  result  and  the  subsequent  detailed 
investigation  of  each  factor.  It  is  usually  developed  in  brainstorming  sessions 
with  those  that  are  familiar  with  the  process  in  question. 


Open  Short  StucK-At  Drift 

Failure  Mode 
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•  Control  Chart:  A  method  of  monitoring  the  output  of  a  process  or  system 
through  the  sample  measurement  of  a  selected  characteristic  and  the 
analysis  of  its  performance  over  time.  There  are  two  main  types:  corrtrol 
charts  for  attributes  (to  plot  percentages  of  "go/no  go’  attribute  data)  and 
control  charts  for  variables  (to  plot  measurements  of  a  variable  characteristic 
such  as  size  or  weight).  Control  charts  identify  changes  in  a  process  as 
indicated  by  drift,  a  shift  in  the  average  value,  or,  increased  variability.  The 
upper  and  lower  control  limits  are  based  on  the  sample  mean  (x),  sample 
standard  deviation  (s)  and  the  sample  size  (n). 


X  +  3  (s/Vn) 

X 

X  -  3  (s/Vn) 
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•  Shewhart  Cycle:  A  method,  created  by  Walter  A.  Shewhart,  for  attacking 
problems. 


The  cycle  starts  with  the  planning  phase:  defining  the  particular  problem, 
deciding  what  data  are  needed  and  determining  how  to  obtain  the  data;  that 
is  via  test,  previous  history,  external  sources,  etc.  The  process  flow  charts 
and  Ishikawa  diagrams  are  very  useful  at  this  point. 
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After  planning  it  is  necessary  to  do  soniething  (D  on  the  chart);  Getting  the 
data  needed,  running  a  test,  making  a  change,  or,  whatever  the  plan  calls  for. 

The  next  step,  C  on  the  chart,  is  to  check  the  results.  In  some  instances,  this 
would  be  done  by  a  control  chart.  In  any  event  the  results  are  evaluated  and 
causes  of  variation  investigated.  Histograms,  Pareto  Charts  and 
Scattergrams  can  be  helpful. 

The  last  step.  A,  stands  for  Analyze  and  Act.  What  did  the  data  in  step  C 
indicate?  Based  on  the  analysis,  appropriate  action  is  taken.  This  could  be  a 
process  change  or  a  decision  that  a  new  plan  is  needed.  In  any  event,  after 
you  act,  you  go  back  to  P  and  start  another  cycle.  Even  if  the  first  trip  around 
worked  wonders,  there  are  always  more  opportunities  waiting  to  be 
discovered.  The  cycle  is  really  a  spiral  going  upward  to  better  and  better 
quality. 

Reliability  TQM  Tasks 

Many  corporations  have  considered  or  utilized  TQM  principles.  The  reliability  tasks 
most  frequently  used  in  producing  a  quality  product  are  assembled  in  the  following 
Pareto  chart: 
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Department  of  Defense  R&M  Policy  and  Procedures 

Department  of  Defense  (DoD)  Directive  5000.1,  Defense  Acquisition  (23  Feb  91). 
establishes  management  policies  and  procedures  for  acquiring  systems  which 
satisfy  all  aspects  of  user  operational  needs.  It  is  based  on  the  principles  contained 
in  the  Defense  Management  Report  to  the  President  (prepared  by  the  Secretary  of 
Defense,  Jul  89).  DoD  Directive  5000.1  cancels  63  other  DoD  directives  and  policy 
memorandum,  and  replaces  them  with  a  single  reference:  DoD  Instruction  5000.2, 
Defense  Acquisition  Policies  and  Procedures  (23  Feb  91).  The  following  R&M 
related  documents  are  included  in  these  cancellations:  (1)  DoD  Instruction  3235.1. 
"Test  and  Evaluation  of  System  Reliability.  Availability  and  Maintainability",  1  Feb 
82,  (2)  DoD  Instruction  4120.19,  "DoD  Parts  Control  Program",  6  Jul  89.  and  (3) 
DoD  Directive  5000.40,  "Reliability  and  Maintainability",  8  Jul  80. 

DoD  Instruction  5000.2  establishes  an  integrated  framework  for  translating  broadly 
stated  mission  needs  into  an  affordable  acquisition  program  that  meets  those 
needs.  It  defines  an  event  oriented  management  process  that  emphasizes 
acquisition  planning,  understanding  of  user  needs  and  risk  management.  It  is 
several  hundred  pages  long  and  has  16  separate  parts  covering  everything  from 
Requirements  Evolution  and  Affordability  to  the  Defense  Acquisition  Board 
Process.  Part  6,  Engineering  and  Manufacturing,  Subsection  C,  Reliability  and 
Maintainability,  establishes  DoD  R&M  policy.  The  basic  R&M  policies  and 
procedures  described  in  this  seven  page  section  can  be  summarized  as  follows: 

Policies 

•  Understand  user  needs  and  requirements. 

•  Actively  manage  all  contributors  to  system  unreliability. 

•  Prevent  design  deficiencies  and  the  use  of  unsuitable  parts. 

•  Develop  robust  systems  insensitive  to  use  environments. 

Procedures 

•  Define  both  mission  and  logistics  R&M  objectives  based  on  operational 
requirements  and  translate  them  into  quantitative  contractual  requirements. 

•  Perform  R&M  allocations,  predictions,  and  design  analysis  as  part  of  an 
iterative  process  to  continually  improve  the  design. 

•  Establish  parts  selection  and  component  derating  guidelines. 

•  Preserve  reliability  during  manufacturing  through  an  aggressive 
environmental  stress  screening  program. 

•  Establish  a  failure  reporting  and  corrective  action  system. 
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•  Perform  reliability  growth  and  demonstration  testing. 

•  Use  MIL-STD-785  (Reliability  Program  for  Systems  &  Equipment, 
Devekjpment  and  Production)  arid  MIL'STD-470  (Maintainability  Program  for 
Systems  &  Equipment)  for  R&M  program  guidance. 

This  Toolkit,  although  not  stmctured  to  address  each  policy  and  procedure  per  se, 
addresses  the  practical  application  of  the  procedures  to  the  development  of  military 
electronic  hardware. 

For  More  Information 

Total  Quality  Improvement."  Boeing  Aerospace  Co.,  PO  Box  3999,  Seattle  WA 
98124;  1987. 

"Total  Quality  Management,  A  Guide  For  implementation."  OoD  500.51-6;  OASD 
(P&L)  TQM,  Pentagon,  Washington  DC;  February  1989. 

"Total  Quality  Management  (TQM),  An  Overview."  RL-TR-91-305;  ADA  242594; 
Anthony  Coppola,  September  1991. 

"A  Rome  Laboratory  Guide  to  Basic  Training  in  TQM  Analysis  Techniques."  RL-TR- 
91-29;  ADA  233855;  Anthony  Coppola,  September  1989. 

DoD  Directive  5000.1,  "Defense  Acquisition,"  23  February  1991. 

DoD  Instruction  5000.2,  "Defense  Acquisition  Policies  and  Procedures,”  23 
February  1991. 
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Paragraphs . A-7 


ROME  LABORATORY  RELIABILITY  ENGINEER’S  TOOLKIT 


9 


Insight 

Requirement  development  is  critical  to  program  success.  Military  standards  (MIL- 
STDs)  cannot  be  blindly  applied.  Requirements  must  be  tailored  to  the  individual 
program  situation  considering  the  following: 

*  Mission  Criticality 

•  Operational  Environment 

*  Phase  of  Development 

•  Other  Contract  Provisions  (incentives,  wananties,  etc.) 

■  Off-The-Shelf  Versus  Newly  Designed  Hardware 


For  More  Information 

MIL-STD-470  "Maintainability  Program  for  Systems  and  Equipment" 

MIL-STD-721  "Definition  of  Terms  for  Reliability  and  Maintainability" 

MIL-STD-785  "Reliability  Program  for  Systems  and  Equipment  Development 
and  Production" 

MIL-STD-21 65  "Testability  Programs  for  Electronic  Systems  and  Equipment" 
DODD  5000.1  "Defense  Acquistion" 

DODI  5000.2  "Defense  Acquisition  Management  Policies  and  Procedures" 

RADC-TR-89-45  "A  Government  Program  Manager's  Testability/Diagnostic 
Guide" 

RADC-TR-90-31  "A  Contractor  Program  Manager's  Testability  Diagnostic  Guide" 
RADC-TR-90-239  "Testability/Diagnostics  Design  Encyclopedia" 

RL-TR-91  -200  "Automated  Testability  Decision  Tool" 
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Topic  R1:  Quantitative  Reliabiiity  Requirements 

Scope  of  Requirements 

Reliability  parameters  expressed  by  operational  users  and  ones  specified  in 
contractual  documents  take  many  forms.  Tables  R1-1  and  R1-2  identify  the 
characteristics  of  reliability  parameters. 


Table  R1-1:  Logistics  (Basic)  and  Mission  Reliability 
Characteristics 

Logistics  (Basic)  Reliability 

Mission  Reliability 

•  Measure  of  system's  ability  to 
operate  without  logistics  support 

•  Measure  of  system's  ability  to 
complete  mission 

•  Recognize  effects  of  all 

occurrences  that  demand  support 
without  regard  to  effect  on  mission 

*  Consider  only  failures  that 
cause  mission  abort 

•  Degraded  by  redundancy 

*  Improved  by  redundancy 

•  Usually  equal  to  or  lower  than 
mission  reliability 

•  Usually  higher  than  logistics 
reliability 

Table  R1-2:  Operational  and  Contractual  Reliability 
Characteristics 


Corrtractual  Reliability _ 

•  Used  to  define,  measure  and 
evaluate  contractor's  program 

•  Derived  from  operational  needs 

•  Selected  such  that  achieving  them 
allows  projected  satisfaction  of 
operational  reliability 

•  Expressed  in  inherent  values 

•  Account  only  for  failure  events 
subject  to  contractor  control 

•  Include  only  design  and 
manufacturing  characteristics 


Operational  Reliability _ 

•  Used  to  describe  reliability 
performance  when  operated 
in  planned  environment 

•  Not  used  for  contract  reliability 
requirements  (requires 
translation) 

•  Used  to  describe  needed  level 
of  reliability  performance 

•  Include  combined  effects  of 
item  design,  quality, 
installation  environment, 
maintenance  policy,  repair, 
etc. 
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Contractual  Reliability 

Operational  Reliability 

•  Typical  terms 

•  Typical  terms 

-  MTBF(mean-time-between-failures) 

-  Mission  MTBF  (sometimes  also 

MTBM  (mean-time-between- 
maintenance) 

called  MTBCF) 

-  MTBD  (mean-time-between- 
demand) 

-  MTBR  (mean-time-between- 
removai) 

MTBCF  (mean-time-between- 
critical-failure) 

Operational  Constraints 

•  Mission  Criticality 

•  Availability  Constraints 

•  Self-Sufficiency  Constraints 

•  Attended/Unattended  Operation 

•  Operational  Environment 

•  Use  of  Off-the-shelf  or  Newly  Designed  Equipment 

How  to  Develop  Requirements 

Figure  R1-1  defines  the  general  reliability  requirement  development  process.  Key 
points  to  recognize  from  this  process  are: 

1.  User  requirements  can  be  expressed  in  a  variety  of  forms  that  include 
combinations  of  mission  and  logistics  reliability,  or  they  may  combine 
reliability  with  maintainability  in  the  form  of  availability.  Conversion  to 
commonly  used  operational  terms  such  as  mean-time-between-maintenance 
(MTBM)  and  mean-time-between-critical-failure  (MTBCF)  must  be  made  from 
terms  such  as  operational  availsdbility  (Ao)  and  break-rate,  etc.,  to  enable 
translation  to  parameters  which  can  be  specified  in  contracts. 

An  example  is: 

A  MTBM 

^0  *  MTBM  +  MDT 

(Solve  for  MTBM  usir^  mean  downtime  (MDT)  which  includes  the  actual 
repair  time  plus  logistics  delay  time.) 
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2.  Since  operational  reliability  measures  take  into  account  factors  beyond  the 
control  of  development  contractors,  they  must  be  translated  to  contractual 
reliability  terms  for  which  contractors  can  be  held  accountable.  (Appendix  1 
provides  one  means  of  accomplishing  this  translation.) 

3.  The  process  cannot  end  with  the  translation  to  a  contractual  value.  Evaluation 
of  the  realism  of  the  translated  requirements  is  a  necessary  step.  Questions 
that  have  to  be  answered  are;  are  the  requirements  compatible  with  the 
available  technology  and  do  the  requirements  unnecessarily  drive  the  design 
(conflict  with  system  constraints  such  as  weight  and  power).  Addressing 
these  issues  requires  reviewing  previous  studies  and  data  for  similar 
systems.  Adjustment  factors  may  be  appropriate  for  improvement  of 
technology  and  for  different  operating  environments,  duty  cycles,  etc.  See 
Topic  A1 1  for  Reliability  Adjustment  Factors. 

4.  Systems  with  mission  critical  requirements  expressed  by  the  user  present 
difficulties  in  the  requirement  development  process.  Translation  models  don't 
account  for  the  nonexponential  situations  that  exist  with  redundant  systems. 
Because  the  reliabilities  of  redundant  paths  are  high  compared  to  serial  ones, 
an  approximation  can  be  made  that  these  paths  have  an  equivalent  failure 
rate  of  zero  so  that  only  the  remaining  serial  elements  need  to  be  translated. 

5.  The  requirement  process  involves  allocation  of  values  to  lower  levels.  In 
some  cases,  this  is  an  iterative  process  requiring  several  tries  to  satisfy  all 
requirements.  For  other  cases,  the  requirements  can't  be  satisfied  and 
dialogue  and  tradeoffs  with  the  user  are  required. 

6.  For  cases  where  user  needs  are  not  specified  it  still  makes  sense  to  invoke  at 
least  a  logistics  (basic)  reliability  requirement.  In  so  doing,  the  contractor  has 
a  degree  of  accountability  and  is  likely  to  put  more  effort  into  designing  a 
reliable  system. 

7.  Table  R1-3  indicates  typical  ranges  of  MTBF  for  different  types  of  electronic 
systems. 
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Table  R1>3:  Typical  MTBF  Values 


Radar  Systems  MTBF  (Hours) 

Ground  Rotating  Search  Radar .  1 00-200 

Large  Fixed  Phase  Array  Radar .  5-10 

Tactical  Ground  Mobile  Radar .  50-100 

Airborne  Fighter  Fire  Control  Radar .  50-200 

Airborne  Search  Radar .  300-500 

Airborne  Identification  Radar .  200-2,000 

Airborne  Navigation  Radar .  300-4,500 

Communications  Equipment  MTBF  (Hours) 

Ground  Radio .  5,000-20,000 

Portable  Ground  Radio .  1 ,000-3,000 

Airborne  Radio .  500-10,000 

Ground  Jammer .  500-2,000 

Ground  Computer  Equipment  MTBF  (Hours) 

Workstation .  2,000-4,500 

Personal  Computer  (CPU)  286/386/486 .  1 ,000-5,000 

Monochrome  Display .  10,000-15,000 

Color  Display .  5,000-1 0,000 

40-100  Megabyte  Hard  Disk  Drive .  10,000-20,000 

Floppy  Disk/Drive .  12,000-30,000 

Tape  Drive .  7,500-12,000 

CD/ROM .  10,000-20,000 

Keyboard .  30 ,000-60,000 

Dot  Matrix,  Low  Speed,  Printer .  2,000-4,000 

Impact,  High  Speed,  Printer .  3,000-12,000 

Thermal  Printer .  10,000-20,000 

Plotter .  30,000-40,000 

Modem .  20.000-30.000 

Mouse . 50,000-200,000 

Clock .  150,000-200,000 

Miscellaneous  Equipment  MTBF  (Hours) 

Airborne  Countermeasures  System .  50-300 

Airborne  Power  Supply .  2,000-20,000 

Ground  Power  Supply .  1 0,000-50,000 

IEEE  Bus .  50,000-100,000 

Ethernet .  35,000-50,000 
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General  Process 


Detailed  Process 


Conversion  of 
User  Needs  to 
TransiataDie 
Operabonai 
Terms 


Translation  of 
Operational  Terms 
to  Contractual 
Terms  (Potential 
Contractual  Requirements) 


Check  Requirements 
for  Realism 


Contractual 

Requirements 


Figure  R1-1:  Quantitative  Reliability  Requirement 
Development  Process 
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Figure  R1-1  Notes: 

1.  User  Needs  Cases 


Case 

1 

2 

3 

4 


LoglatIcaRellabItity 

Specified 

Specified 
Not  specified 
Not  specified 


Mission  Rellabtllty  Comments _ 

Specified 

Not  specified  Delete  steps  D,  H,  I 

Specified 

Not  specified  Delete  steps  D,  H,  I 


2.  A  10-20%  reliability  improvement  factor  is  reasonable  for  advancement  of 
technology. 

3.  Adjustment  of  data  to  use  environment  may  be  required  (see  Topic  All).  See 
Appendix  8  for  R&M  data  sources. 

4.  Reliability  requirements  necessitating  redundancy  add  weight,  cost  and 
power. 

5.  Alternate  forms  of  user  requirements  should  be  converted  to  MTBM's  to 
enable  translation. 
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Topic  R2:  Quofitilativo  Malntaiiuibility  Roquifomonts 


Scope  of  Requirements 

Unique  maintainability  parameters  need  to  be  specified  for  three  basic  levels  of 
repair: 

•  Organizational  Level:  Repair  at  the  system  location.  Usually  involves 
replacing  plug-in  modules  and  other  items  with  relatively  short  isolation  and 
replacement  times. 

•  Intermediate  Level:  Repair  at  an  intennediate  shop  facility  which  has  more 
extensive  capabilities  to  repair  lower  hardware  indenture  levels. 

•  Depot  Level:  Highly  specialized  repair  facility  capable  of  making  repairs  at 
all  hardware  indenture  levels.  Sometimes  the  original  equipment 
manufacturer. 

Recent  Air  Force  policy  has  promoted  the  concept  of  two  level  maintenance  in 
place  of  the  traditional  three  level  system.  Under  this  concept  the  classification  is: 

•  On-equlpmem:  Maintenance  actions  accomplished  on  complete  end  items. 

•  Off*equlpment:  In-shop  maintenance  actions  performed  on  removed 
components. 

Parameters  which  need  to  be  specified  vary  with  the  level  of  repair  being 
considered.  Key  maintainability  parameters  include: 

«  Mean  time  to  repair  (MTTR):  Average  time  required  to  bring  system  from  a 
failed  state  to  an  operational  state.  Strictly  design  dependent.  Assumes 
maintenance  personnel  and  spares  are  on  hand  (i.e.,  does  not  include 
logistics  delay  time).  MTTR  is  used  interchangeably  with  mean  corrective 
maintenance  time  (Met). 

•  Mean  maintenance  manhours  (M«MMH):  Total  manpower  per  year 
(expressed  in  manhours)  required  to  keep  the  system  operating  (not  including 
logistics  delay  time). 

•  Mean  time  to  restore  system  (MTTRS):  The  average  time  it  takes  to 
restore  a  system  from  a  failed  state  to  an  operable  state,  including  logistics 
delay  time  MTTRS  =  logistics  delay  time  +  MTTR).  Logistics  delay  time 
includes  all  time  to  obtain  spares  and  personnel  to  start  the  repair. 

•  Preventive  maintenance  (PM):  Time  associated  with  the  performance  of  all 
required  preventive  maintenance.  Usually  expressed  in  terms  of  hours  per 
year. 
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Operational  Constraints 

Basic  maintainability  requirements  are  determined  through  an  analysis  of  user 
operational  constraints.  Operational  constraints  include: 

•  Operating  hours  per  unit  calendar  time  and/or  per  mission 

•  Downtime,  maintenarKe  time,  or  availability  constraints 

•  Mobility  requirements 

•  Attended/unattended  operation 

•  Self-sufficiency  constraints 

•  Reaction  time 

•  Operational  environment  (e.g.,  chemical,  biological  and  nuclear) 

•  Skill  levels  of  maintenance  personnel 

•  Manning 

•  Types  of  diagnostics  and  maintenance  support  equipment  which  can  be 
made  available  or  implemented  (built-in  test,  manual  test  equipment,  external 
automatic  test  equipment,  etc.). 

•  Levels  at  which  repair  takes  place 

•  Use  of  off-the-shelf  equipment  versus  newly  designed  equipment 

How  to  Develop  Requirements 

The  best  guidance  available  is  to  provide  a  range  of  typical  values  usually  applied 
for  each  parameter. 
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Table  R2-1 :  Typical  Maintainability  Values 

Organizational  Intermediate 

Depot 

MTTR 

.5-1.5  hr 

.5  -  3  hr 

1  -4  hr 

M-MMH 

Note  1 

Note  1 

Note  1 

MTTRS 

1  -  8  Hrs  (Note  2) 

NA 

NA 

PM 

2-15  hr/yr 

NA 

NA 

Notes: 

1 .  M-MMH  depends  on  the  number  of  repair  visits  to  be  made,  the  MTTR  for 
each  repair  visit  and  the  number  of  maintenance  personnel  required  for  each 
visit.  Typical  calculations  of  the  mean  maintenance  manhours  per  year 
include; 

a.  Immediate  maintenance  of  a  continuously  operated  system:  M-MMH  = 
(8760  hr/yr)/(MTBF)  x  (MTTR)  x  (maintenance  personnel  per  repair)  + 
(PM  hours  per  year)  x  (Maintenance  personnel). 

b.  Delayed  maintenance  of  a  fault  tolerant  system:  M-MMH  =  (number  of 
expected  repair  visits)  x  (time  for  each  visit)  x  (maintenance  personnel 
per  visit)  +  (PM  hours  per  year)  x  (Maintenance  personnel). 

c.  Maintenance  of  a  continuously  operated  redundant  system  allowed  to 
operate  until  failure.  M-MMH  =  (8760  Mr/yr)/(MTBCF)  x  (time  for  each 
visit)  X  (maintenance  personnel  per  visit)  +  (PM  hours  per  y^ar)  x 
(Maintenance  personnel). 

Time  for  each  visit  is  the  number  of  repairs  to  be  made  times  the  MTTR  for 
each  repair  if  repairs  are  made  in  series. 

2.  For  unique  systems  that  are  highly  redundant,  MTTRS  may  be  specified  as 
the  switch  time. 
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Topic  R3:  Quantitative  Testability/Diagnostic 
R^irements 

Scope  of  Requirements 

Testability/Diagnostics  functions  and  parameters  that  apply  to  each  repair  level: 

•  Faun  Detection:  A  process  which  discovers  the  existence  of  faults. 

•  Fault  Isolation:  Where  a  fault  is  known  to  exist,  a  process  which  identifies 
one  or  more  replaceable  units  where  the  fautt(s}  may  be  located. 

•  False  Alarms:  An  indication  of  a  fault  where  no  fault  exists  such  as  operator 
error  or  Built-in  Test  (BIT)  design  deficiency. 

Testability/Diagnostic  requirements  are  sometimes  expressed  in  the  form  of  rates 
or  fractions  such  as; 

•  Fraction  of  Faults  Detected  (FFD):  The  quantity  of  faults  detected  by  BIT 
or  External  Test  B^uipment  (ETE)  divided  by  the  quantity  of  faults  detected 
by  all  fault  detection  means  (including  manual). 

•  System  and  Equipment  Level  -  FFD  is  usually  weighted  by  the 
measured  or  predicted  failure  rates  of  the  faults  or  replaceable  units. 

-  Microcircuit  Level  -  FFD  is  called  fault  coverage  or  fault  detection 
coverage,  and  all  faults  are  weighted  ^ually.  In  the  fault-tolerant  design 
community,  "fault  coverage"  almost  invariably  refers  to  fault  recovery 
coverage.  This  is  usually  expressed  as  the  conditional  probability  that, 
given  a  fault  has  occurred  and  has  been  detected,  the  system  will 
recover. 

•  Fault  Isolation  Resolution  (FIR):  The  probability  that  any  detected  fault 
can  be  isolated  by  BIT  or  ETE  to  an  ambiguity  group  of  size  "x"  or  less. 
(Typically  specified  for  several  values  of  "x"). 

•  False  Alarm  Rate  (FAR):  The  frequency  of  occurrence  of  false  alarms. 

Scope  of  Diagnostics 

•  Embedded:  Defined  as  any  portion  of  the  weapon  system's  diagnostic 
capability  that  is  an  integral  part  of  the  prime  system. 

•  External:  Any  portion  of  the  diagnostic  capability  that  is  not  embedded. 

•  Manual:  Testing  that  requires  the  use  of  technical  manuals,  troubleshooting 
procedures,  and  general-purpose  test  equipment  (e.g.,  voltmeter)  by  a 
maintenance  technician. 
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•  Test  Program  Set  (TPS):  The  complete  collection  of  data  and  hardware 
necessary  to  test  a  specific  Unit  Under  Test  (UUT)  on  a  specific  Automatic 
Test  Equipment  (ATE).  As  a  minimum,  a  TPS  consists  of: 

-  Test  vector  sets  (for  a  digital  UUT) 

-  Test  application  programs  (software  that  executes  on  the  ATE  and 
appiies  the  vectors  under  the  necessary  conditions) 

Test  fixtures  and  ATE  configuration  files 

Documentation 

A  major  element  of  external  diagnostics  involves  the  following: 

•  Automatic  Test  Equipment  (ATE):  The  apparatus  with  which  the  actual 
UUT  will  be  tested.  ATE  for  digital  UUTs  has  the  capability  to  apply 
sequences  of  test  vectors  under  specified  timing,  loading,  and  forcing 
conditions. 

How  to  Develop  Requirements 

In  theory,  weapon  system  diagnostic  requirements  should  be  developed  as  an  out¬ 
growth  of  the  user  developed  mission  and  performance  requirements  contained  in  a 
Mission  Need  Statement  (MNS),  Operational  Reqqirements  Document  (ORD)  or 
similar  type  document. 

The  following  should  also  be  considered: 

•  Diagnostic  capability  realistically  achievable  with  the  selected  hardware 
technology  and  software  complexity. 

•  Tradeoffs  involving  reliability,  maintainability,  logistics,  weight,  power 
requirements,  and  system  interruption. 
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Table  R3-1 :  Typical  Testability  Values 


%  Capability 

Repair  Level 

Fault  Detection  (All  Means) 

90-100 

Organizational 

100 

Intermediate 

100 

Depot 

Fault  Detection:  BIT  &  ETE 

90-98 

Organizational 

BIT  4  ETE 

95-98 

Intermediate 

BIT  4  ETE 

95-100 

Depot 

Fault  Isolation  Resolution 

Three  or  fewer  LRUs 

100 

Organizational 

One  LRU 

90-95 

Organizational 

Four  or  fewer  SR  Us 

100 

Intermediate 

One  SRU 

75-85 

Intermediate 

Notes: 

LRU  -  Line-Replaceable  Unit  (e.g.,  Box,  Power  Supply,  etc.) 
SRU  •  Shop-Replaceable  Unit  (e.g..  Circuit  Card) 

BIT  -  Built-in-Test 

ETE  -  External  Test  Equipment 
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Topic  R4:  Program  Phase  Torminology 

The  R&M  tasks  required  on  a  program  are  based  on  the  program's  development 
phase  and  intended  application  (ground,  airborne,  space,  etc.). 
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REQUIREMENTS  -  TOPIC  R5 


Topic  R5:  Reliability  and  Maintainability  Taak 
Application/Prioritias 
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REQUIREMENTS  -  TOPIC  R6 


Topic  R6:  Contract  Data  Requirements 

In  order  for  the  government  to  receive  outputs  from  the  required  contractor 
performed  tasks,  the  appropriate  deliverables  must  be  specified  in  the  Contract 
Data  Requirements  List  (CORL).  The  content  of  these  CORL  items  is  specified  by 
reference  to  standard  Data  Item  Descriptions.  The  timing  and  frequency  of  the 
required  reports  must  be  specified  in  the  CDRL. 

Table  R6-1 :  Data  Items  &  Delivery  Dates 


Title 

Recommended  Delivery  Date 

Reliability 

DI-R-7079 

Reliability  Program  Plan 

90  days  prior  to  PDR 

DI-R-7080 

Reliability  Status  Report 

90  days  prior  to  PDR  & 
bimonthly 

DI-R-7083 

Sneak  Circuit  Analysis  Report 

30  days  prior  to  PDR  &  CDR 

DI-R-70a5A 

FMECA  Report 

30  days  prior  to  CDR 

DI-R-7086 

FMECA  Plan 

90  days  prior  to  PDR 

DI-R-7094 

Reliability  Block  Diagram  & 

Math  Model  Report 

30  days  prior  to  PDR  &  CDR 

DI-R-7095 

Reliability  Prediction  & 
Documentation  of  Supporting 
Data 

30  days  prior  to  PDR  &  CDR 

DI-R-7100 

Reliability  Report  for 

Exploratory  Development 

Models 

30  days  prior  to  end  of  contract 

DI-RELI-80247 

Thermal  Survey  Report 

30  days  prior  to  PDR  &  after 
testing 

DI-RELI-80248 

Vibration  Survey  Report 

90  days  prior  to  start  of  testing 

DI-RELI-80249 

Burn-in  Test  Report 

60  days  after  end  of  testing 

DI-RELI-80250 

Reliability  Test  Plan 

90  days  prior  to  start  of  testing 

DI-RELI-80251 

Reliability  Test  Procedures 

30  days  prior  to  start  of  testing 

Dl-RELI-80252 

Reliability  Test  Report 

60  days  after  end  of  testing 

DI-RELI-80253 

Failed  Item  Analysis  Report 

As  required 

DI-RELI-80254 

Corrective  Action  Plan 

30  days  after  end  of  testing 
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Htto 

Rscommcndad  Dtlivtry  Date 

DI-RELI-80255 

Failure  Summary  &  Analysis 

Report 

Start  of  testing,  monthly 

DI-RELI-80685 

Critical  Item  Control  Plan 

30  days  prior  to  PDR 

DI-MISC-80071 

Part  Approval  Request 

As  Required 

Maintainability 

DI-MNTY-80822 

Maintainability  Program  Plan 

90  days  prior  to  PDR 

DI-MNTY-80823 

Maintainability  Status  Report 

90  days  prior  to  PDR  & 
bimonthly 

DI-MNTY-80824 

Data  Collection,  Analysis  & 
Corrective  Action  System 

Reports 

As  Required 

DI-MNTY-80825 

Maintainability  Modeling  Report 

30  days  prior  to  PDR  &  CDR 

DI-MNTY-80826 

Maintainability  Allocations 

Report 

30  days  prior  to  PDR  &  CDR 

DI-MNTY-80827 

Maintainability  Predictions 

Report 

30  days  prior  to  PDR  &  CDR 

DI-MNTY-80828 

Maintainability  Analysis  Report 

30  days  prior  to  PDR  &  CDR 

DI-MNTY-80829 

Maintainability  Design  Criteria 

Plan 

90  days  prior  to  PDR 

DI-MNTY-80830 

Inputs  to  the  Detailed 

Maintenance  Plan  &  Logistics 
Support 

As  required 

DI-MNTY-80831 

Maintainability  Demonstration 

Test  Plan 

90  days  prior  to  start  of  testing 

DI-MNTY-80832 

Maintainability  Demonstration 
Report 

30  days  after  end  of  testing 

Testability 

DI-R-7080  & 
DI-RELI-80255 

DI-MNTY-80831 
&  80832 

(See  Reliability  &  Maintainability  Data  Item  List) 

(See  Maintainability  Data  Item  List) 

DI-T-7198 

Testability  Program  Plan 

90  Days  prior  to  PDR 

DI-T-7199 

Testability  Analysis  Report 

30  days  prior  to  PDR  &  CDR 
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REQUIREMENTS  -  TOPIC  R7 


Topic  R7:  R&M  Information  for  Proposals 

Proposal  preparation  guidance  shouid  be  provided  in  the  request  for  proposal 
(RFP)  package  to  guide  the  contractor  in  providing  the  information  most  needed  to 
properly  evaluate  the  R&M  area  during  source  selection.  This  is  part  of  the 
requirements  definition  process. 

Depending  on  the  scope  of  the  R&M  requirements  specified,  information  such  as 
the  following  should  be  requested  for  inclusion  in  the  proposal: 


•  Preliminary  R&M  analysis/nxxiels  and  estimates  of  values  to  be  achieved  (to 
at  least  the  line  replaceable  unit  (LRU)  level) 

•  Design  approach  (including  thermal  design,  parts  derating,  and  parts  control) 

•  R&M  organization  and  its  role  in  the  overall  program 

•  Key  R&M  personnel  experience 

•  Schedules  for  all  R&M  tasks 

•  Description  of  R&M  design  guidelines/criteria  to  be  used  and  trade  studies 
and  testing  to  be  performed 


Note: 

It  is  critical  that  qualified  R&M  personnel  take  part  in  the  actual  evaluation  of 
technical  proposals.  The  R&M  engineer  should  make  sure  this  happens  by 
agreement  with  program  management. 
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Source  Selection 


Contents 


Proposal  Evaluation  for  Reliability . 31 

and  Maintainability 
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Insight 

The  criteria  for  evaluation  of  contractor  proposals  has  to  match  the  requirements 
specified  in  the  Request  for  Proposal  (RFP).  Contractors  must  be  scored  by 
comparing  their  proposals  to  the  criteria,  not  to  each  other.  R&M  are  generally 
evahjated  as  parts  of  the  technical  area.  The  total  source  selection  process 
includes  other  nontechnical  areas.  Air  Force  policy  has  emphasized  the  importance 
of  R&M  in  the  source  selection  process. 


For  More 

AFR  70-15 
AFR  70-30 


Information 

"Source  Selection  Policy  and  Procedures" 
"Streamlined  Source  Selection  Procedures" 
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Topic  SI:  Proposal  Evaluation  for  Reliability 
and  Maintainability 

Understanding 

•  Does  the  contractor  show  understanding  of  the  importance  of  designing  in 
R&M&T  in  the  effort? 

•  Does  the  contractor  show  a  firm  understanding  of  R&M&T  techniques, 
methodology,  and  concepts? 

•  Does  the  contractor  indicate  understanding  of  the  role  of 
testability/diagnostics  on  maintainability  and  maintenance? 

•  Does  the  contractor  understand  integrated  diagnostics  design  principles? 

•  Does  the  contractor  note  similar  successful  R&M&T  efforts? 

Approach 

•  Management 

-  Is  an  R&M&T  manager  identified,  and  are  his/her  experience  and 
qualifications  adequate  in  light  of  the  scope  of  the  overall  program? 

Are  the  number  and  experience  of  R&M&T  personnel  assigned  to  the 
program,  and  the  number  of  manhours  adequate,  judged  in 
accordance  with  the  scope  of  the  overall  program? 

Does  the  R&M&T  group  have  adequate  stature  and  authority  in  the 
organizational  framework  of  the  program  (e.g.,  they  should  not  fall 
under  direct  control  of  the  design  group)? 

Does  the  R&M&T  group  have  an  effective  means  of  crosstalk  and 
feedback  of  information  between  design  engineers  and  higher 
management? 

Does  the  R&M&T  manager  have  adequate  control  over  R&M&T  for 
subcontractors  and  vendors? 

-  Is  the  testability  diagnostics  function  integrated  into  the  R&M  program? 

Does  the  contractor  utilize  concurrent  engineering  practices  and  is  the 
R&M&T  group  represented  on  the  team? 

•  Design 

-  Are  design  standards,  guidelines  and  criteria  such  as  part  derating, 
thermal  design,  modular  construction.  Environmental  Stress  Screening 
(ESS),  and  testability  cited? 
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is  the  contractor's  failure  reporting  and  corrective  action  system 
(FRACAS)  a  dosed  loop  controlled  process? 

Is  there  a  commitment  to  the  required  parts  control  program  (e.g.,  MIL- 
M-38510,  MIL-STO-883.  etc.)?  Are  approval  procedures  described/ 
proposed  for  nonstandard  parts? 

Are  system  design  reviews  (internal  and  external)  required  regularly? 

Are  tradeoff  studies  proposed  for  critical  design  areas? 

Is  a  time-phasing  of  R&M&T  tasks  provided  along  with  key  program 
milestones? 

-  Are  areas  of  R&M&T  risk  iderrtified  and  discussed? 

-  Does  the  contractor  inchjde  consideration  of  software  reliability? 

Does  the  contractor  describe  his  plan  for  testability/di^nostics  design 
and  the  potential  impacts  on  reliabinty  and  maintainability? 

•  Does  the  contractor  identify  tools  to  be  used  to  generate  test  vectors 
and  other  diagnostic  procedures  for  BIT  and  ATE  (automatic  test 
equipment)? 

•  Analysis/Test 

•  Are  methods  of  analysis  and  math  models  presented? 

-  Are  the  R&M&T  prediction  and  allocation  procedures  described? 

-  Has  the  time  phasing  of  the  R&M&T  testing  been  discussed,  and  is  it 
consistent  with  the  overall  program  schedule? 

-  Is  adequate  time  available  for  the  test  type  required  (such  as  maximum 
time  for  sequential  test)? 

-  Is  the  ESS  program  consistent  with  the  requirements  in  terms  of 
methodology  and  scheduling? 

-  Does  the  contractor  make  a  commitment  to  predict  the  design 
requirement  MTBF  prior  to  the  start  of  testing? 

Are  the  resources  (test  chambers,  special  equipment,  etc.)  needed  to 
perform  all  required  testing  identified  and,  is  a  commitment  made  to 
their  availability? 
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Compliance 

•  Design 

Does  the  contractor  indicate  compliance  with  all  recpjired  military 
specifications  for  reliability,  maintainability  and  testability? 

Is  adequate  justification  (models,  preliminary  estimates,  data  sources, 
etc.)  provided  to  backup  the  claims  of  meeting  R&M&T  requirements? 

Is  there  an  explicit  commitment  to  meet  any  ease  of  maintenance  and 
preventive  maintenance  requirements? 

Is  there  an  explicit  commitment  to  meet  the  Built-in-Test  (BrT)/Fault- 
isolation  Test  (FIT)  rec^irements  (Fraction  of  Faults  Detected  (FFD), 
Fault  Isolation  Resolution  (FIR)  and  False  Alarm  Rate  (FAR) )? 

Is  each  equipment  environmental  limitation  specified  and  do  these 
conditions  satisfy  the  system  requirements? 

Are  all  removable  modules  keyed? 

Will  derating  requirements  be  adhered  to  and  are  methods  of  verifying 
derating  requirements  discussed? 

•  Analysis/Test 

-  Is  a  commitment  made  to  perform  a  detailed  thermal  analysis? 

•  Will  the  contractor  comply  with  all  R&M&T  required  analyses? 

Is  there  an  explicit  commitment  to  perfomi  all  required  environmental 
stress  screening? 

Does  the  contractor  comply  with  all  system  level  R&M&T  test 
requirements?  Will  the  contr£K;tor  demonstrate  the  R&M&T  figures  of 
merit  (MTBF,  MTTR,  FFD,  FIR  and  FAR)  using  the  specified 
accept/reject  criteria? 

-  Does  the  contractor  comply  with  the  specification  (or  other  commonly 
specified)  failure  definitions? 

-  Does  the  contractor  agree  to  perform  themial  verification  tests  and 
derating  verification  tests? 

•  Data 

Is  there  an  explicit  commitment  to  deliver  and  comply  with  all  of  the 
required  R&M&T  data  items? 
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Section  D 

Design 


_ Contents 

D1  Part  Stress  Derating . 37 

D2  Thermal  Design . . . 44 

D3  Parts  Control . 46 

D4  Review  Questions . 55 

D5  Critical  Item  Checklist . 62 

D6  Dormancy  Design  Control . 63 

D7  Surface  Mount  Technology  (SMT)  Design . 66 

D8  Power  Supply  Design  Checklist . 67 

D9  Part  Failure  Modes  and  Mechanisms . 69 

D1 0  Fiber  Optic  Design  Criteria . 73 
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Insight 

Proven  design  approaches  are  critical  to  system  R&M  success.  For  many 
programs  the  government  requires  that  certain  approaches  be  used  (such  as  a 
particular  level  of  part  stress  derating).  Other  programs  allow  the  contractor  to 
develop  and  use  his  own  design  criteria  as  long  as  his  end  product  design  meets 
the  government  requirements  or  is  sut^ect  to  provisions  of  prockjct  performance 
agreements  (guarantees,  warranties,  etc.).  Regardless  of  the  situation,  the  R&M 
engineer  must  actively  evaluate  the  contractor  design  progress. 


For  More  Information 

MIL-STD-883  “Test  Methods  and  Procedures  for  Microelectronics" 

MIL-STD-965  “Parts  Control  Program" 

MIL-STD-1521  “Technical  Reviews  and  Audits  for  Systems, 

Equipments,  and  Computer  Software" 

MIL-HDBK-251  “Reliability/Design  Thermal  Applications" 

MIL-HDBK-338  "Electronic  Reliability  Design  Handbook" 

MIL-HDBK-978  "NASA  Parts  Application  Handbook" 

MIL-M-3851 0  "Microcircuits,  General  Specification  for" 

MIL-S-19500  "Semiconductor  Devices,  General  Specification  for" 

RADC-TR-82-1 72  "R ADC  Thermal  Guide  for  Reliability  Engineers" 

RADC-TR-88-69  "R/M/T  Design  for  Fault  Tolerance,  Program  Manager's 
Guide" 

RADC-TR-88-1 1 0  "Reliability/Maintainability/Testability  Design  for  Dormancy" 

RADC-TR-88-1 24  "Impact  of  Fiber  Optics  on  System  Reliability/Maintainability" 

RL-TR-91  -39  "Reliability  Design  for  Fault  Tolerant  Power  Supplies" 

RL-TR-92-1 1  "Advanced  Technology  Component  Derating" 


36 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


DESIGN  •  TOPIC  D1 


Topic  D1 :  Part  Stress  Derating 

The  practice  of  limiting  electrical,  thermal  and  mechanical  stresses  on  parts  to 
levels  below  their  specified  ratings  is  called  derating.  If  a  system  is  expected  to  be 
reliable,  one  of  the  major  contributing  factors  must  be  a  conservative  design 
approach  incorporating  realistic  derating  of  parts.  Table  D1-1  defines  the  key 
factors  for  determining  the  appropriate  level  of  derating  for  the  given  system 
constraints.  Table  D1-2  indicates  the  specific  derating  factors  for  each  part  type. 


Table  D1-1:  Part  Derating  Level  Determination 

Factors  Score 

Reliability  •  For  proven  design,  achievable  with  standard  1 

Challenge  parts/circuits 

•  For  high  reliability  requirements,  special  design  features  2 
needed 

•  For  new  design  challenging  the  state-of-the-art,  new  3 

concept 

System  Repair  •  For  easily  accessible,  quickly  and  economically  repaired  1 
systems 

•  For  high  repair  cost,  limited  access,  high  skill  levels  2 

required,  very  low  downtimes  aibwable 

•  For  nonaccessible  repair,  or  economically  unjustifiable  3 

repairs 

Safety  •  For  routine  safety  program,  no  expected  problems  1 

•  For  potential  system  or  equipment  h/gh  cost  damage  2 

•  For  potential  jeopardization  of  life  of  personnel  3 

Size,  Weight  •  For  no  significant  design  limitation,  standard pract/ces  1 

•  For  special  design  features  needed,  difficult  2 

requirements 

•  For  new  concepts  needed,  severe  design  limitation  3 

Life  Cycle  •  For  economical  repairs,  no  unusual  spare  part  costs  1 

expected 

•  For  potentially  high  repair  cost  or  unique  cost  spares  2 

_ »  For  systems  that  may  require  complete  substitution _ 3_ 


Instructions:  Select  score  for  each  factor,  sum  and  determine  derating  level  or  parameter. 

Derating  Level  Total  Score 

I  11-15 

II  7-10 

III  6  or  less 
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Table  D1>2:  Part  Derating  Levels 

All  of  the  percentages  provided  are  of  the  rated  value  for  the  derating  parameter, 
unless  otherwise  labeled.  Temperature  derating  is  from  the  maximum  rated. 

Part  Type 

Derating  Parameter 

1 

Derating  Level 
n  Ml 

Capacitors 

•  Rim,  Mica,  Glass 

DC  Voltage 

50% 

60% 

60% 

Temp  from  Max  Limit 

to'c 

10*C 

10*C 

•  Ceramic 

DC  Voltage 

50% 

60% 

60% 

Temp  from  Max  Limit 

io»c 

10‘C 

10»C 

•  Electrolytic  Aluminum 

DC  Voltage 

80% 

Temp  from  Max  Limit 

“ 

- 

20*C 

•  Electrolytic  Tantalum 

DC  Voltage 

50% 

60% 

60% 

Temp  from  Max  Limit 

20*C 

20“C 

20'’C 

•  Solid  Tantalum 

DC  Voltage 

50% 

60% 

60% 

Max  Operating  Temp 

85*C 

85*C 

85*C 

•  Variable  Piston 

DC  Voltage 

40% 

50% 

50% 

Temp  from  Max  Limit 

10*C 

10*C 

lo’c 

•  Variable  Ceramic 

DC  Voltage 

30% 

50% 

50% 

Temp  from  Max  Limit 

io“c 

10*C 

lo'c 

Connectors 

Voltage 

50% 

70% 

70% 

Current 

50% 

70% 

70% 

insert  Temp  from  Max  Limit 

50"C 

25'’C 

25'*C 

Diodes 


•  Signal/Switch 

FoHMard  Current 

50% 

65% 

75% 

(Axial  Lead) 

Reverse  Voltage 

70% 

70% 

70% 

Max  Junction  Temp 

95°C 

105°C 

125'’C 

•  Voltage  Regulator 

Power  Dissipation 

50% 

60% 

70% 

Max  Junction  Temp 

95'’C 

105°C 

125'’C 

•  Voltage  Reference 

Max  Junction  Temp 

95'’C 

tos'c 

125'C 
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Derating  Laval 

PartTyp* 

Derating  Parameter 

1 

H 

HI 

Diodes  (cont'd) 

•  Transient  Suppressor 

Power  Dissipation 

50% 

60% 

70% 

Average  Current 

50% 

65% 

75% 

Max  Junction  Temp 

95‘’C 

105*C 

125*C 

•  Microwave 

Power  Dissipation 

50% 

60% 

70% 

Reverse  Voltage 

70% 

70% 

70% 

Max  Junction  Temp 

95'’C 

105'C 

125'C 

•  Light  Emitting  Diode 

Average  Foneard  Current 

50% 

65% 

75% 

(LED) 

Max  Junction  Temp 

95»C 

105"C 

1250C 

•  Schottky/Positive 

Power  Dissipation 

50% 

60% 

70% 

Intrinsic  Negative 

Reverse  Voltage 

70% 

70% 

70% 

(PIN)  (Axial  Lead) 

Max  Junction  Temp 

95“C 

105‘’C 

125*C 

•  Power  Rectifier 

Forward  Current 

50% 

65% 

75% 

Reverse  Voltage 

70% 

70% 

70% 

Max  Junction  Temp 

95‘’C 

105‘’C 

125*C 

Fiber  Optics 

•  Cable 

Bend  Radius 

(%  of  Minimum  Rated) 

200% 

200% 

200% 

Cable  Tension 

50% 

50% 

50% 

(%  Rated  Tensile  Strength) 
Fiber  Tension 

20% 

20% 

20% 

(%  Proof  Test) 

Inductors 

•  Pulse  Transformers 

Operating  Current 

60% 

60% 

60% 

Dielectric  Voltage 

50% 

50% 

50% 

Temp  from  Max  Hot  Spot 

40"C 

25°C 

15'C 

•  Coils 

Operating  Current 

60% 

60% 

60% 

Dielectric  Voltage 

50% 

50% 

50% 

1 

Temp  from  Max  Hot  Spot 

40'C 

25°C 

15“C 

Lamps 

•  Incandescent 

Voltage 

94% 

94% 

94% 

•  Neon 

Current 

94% 

94% 

94% 
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Microcircuits:  This  derating  criteria  is  based  on  available  data  and  is  limited  to: 
60,000  gates  for  digital  devices,  10,000  transistors  for  linear  devices,  and  1  Mbit  for 
memory  devices.  Microcircuits  should  not  exceed  supplier  minimum  or  maximum 
rating  for  supply  voltage,  12SX  junction  temperature  (except  GaAs),  or  supplier 
maximum. 


Darating  Laval 

Part  Type 

Derating  Parameter 

1 

N 

HI 

Microcircuits 

•  MOS  Digital 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Frequency  (%  of  Max  Spec) 

80% 

80% 

80% 

Output  Current 

70% 

75% 

80% 

Fan  Out 

80% 

80% 

90% 

Max  Junction  Temp 

80*C 

110*C 

125’C 

•  MOS  Linear 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Input  Voltage 

60% 

70% 

70% 

Frequency  (%  of  Max  Spec) 

80% 

80% 

80% 

Output  Current 

70% 

75% 

80% 

Fan  Out 

80% 

80% 

90% 

Max  Junction  Temp 

85‘C 

iio“c 

125’C 

•  Bipolar  Digital 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Frequency  (%  of  Max  Spec) 

75% 

80% 

90% 

Output  Current 

70% 

75% 

80% 

Fan  Out 

70% 

75% 

80% 

Max  Junction  Temp 

80*C 

iio’c 

125*0 

•  Bipolar  Linear 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Input  Voltage 

60% 

70% 

70% 

Frequency  (%  of  Max  Spec) 

75% 

80% 

90% 

Output  Current 

70% 

75% 

80% 

Fan  Out 

70% 

75% 

80% 

Max  Junction  Temp 

85“C 

iio’c 

125’C 

Microprocessors 

•  MOS 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Frequency  (%  of  Max  Spec) 

80% 

80% 

80% 

Output  Current 

70% 

75% 

80% 

Fan  Out 

80% 

80% 

90% 

Max  Junction  Temp,  B-BIT 

120‘>C 

125*C 

125*C 

Max  Junction  Temp.  16-BIT 

90'C 

125'>C 

125“C 

Max  Junction  Temp,  32-BIT 

60“C 

lOO'C 

125''C 
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Derating  Level 

Pert  Type _ Derating  Parameter _ I _ H _ HI 


Microprocessors  (cont'd) 


•  Bipolar 

Supply  Voltage 

Frequency  (%  of  Max  Spec) 
Output  Current 

Fan  Out 

Max  Junctbn  Temp,  8-BIT 

Max  Junction  Temp,  16-BIT 

Max  Junction  Temp,  32-BiT 

+/-3% 

75% 

70% 

70% 

80*C 

70*C 

60“C 

+/-5% 

80% 

75% 

75% 

110*C 

iio-c 

100"C 

+/-5% 

90% 

80% 

80% 

125*C 

125*C 

125*C 

Memory/PROM 

•  MOS 

Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Frequency  (%  of  Max  Spec) 

80% 

80% 

90% 

Output  Current 

70% 

75% 

80% 

Max  Junction  Temp 

125‘’C 

125*C 

125‘‘C 

Max  Write  Cycles  (EEPROM) 

13,000 

105,000 

300,000 

•  Bipolar 

Fixed  Supply  Voltage 

+/-3% 

+/-5% 

+/-5% 

Frequency  (%  of  Max  Spec) 

80% 

90% 

95% 

Output  Current 

70% 

75% 

80% 

Max  Junction  Temp 

125“C 

125‘’C 

125*C 

Microcircuits,  GaAs 

•  MMIC/Digital  Max  Channel  Temp  gO'C  125'C  150*0 

Miscellaneous 


•  Circuit  Breakers 

Current 

75% 

80% 

80% 

•  Fuses 

Current 

50% 

50% 

50% 

Optoelectronic  Devices 

•  Photo  Transistor 

Max  Junction  Temp 

95‘>C 

105*C 

125*C 

•  Avalanche  Photo 

Diode  (APD) 

Max  Junction  Temp 

95'’C 

105“C 

125‘’C 

•  Photo  Diode,  PIN 
(Positive  Intrinsic 
Negative) 

Reverse  Voltage 

Max  Junction  Temp 

70% 

95*C 

70% 

105'>C 

70% 

125^ 

•  Injection  Laser  Diode 

Power  Output 

Max  Junction  Temp 

50% 

95’>C 

60% 

105*C 

70% 

IIO^C 
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PartTViM 

Derating  Parametar 

1 

Derating  Level 

II  M 

Relays 

Resistive  Load  Current 

50% 

75% 

75% 

Capacitive  Load  Current 

50% 

75% 

75% 

Inductive  Load  Current 

35% 

40% 

40% 

Contact  Power 

40% 

50% 

50% 

Temp  from  Max  Limit 

20“C 

20*C 

20*C 

Resistors 

•  Composition 

Power  Dissipation 

50% 

50% 

50% 

Temp  from  Max  Limit 

ao^c 

30*C 

ao^c 

•  Rim 

Power  Dissipation 

50% 

50% 

50% 

Tamp  from  Max  Limit 

40‘C 

40‘>C 

40*C 

’bid 

Power  Dissipation 

50% 

50% 

50% 

Temp  from  Max  Limit 

45'’C 

35*C 

35''C 

•  Thermistor 

Power  Dissipation 

50% 

50% 

50% 

Temp  from  Max  Limit 

20*C 

20‘C 

2CC 

•  Wirewound  Accurate 

Power  Dissipation 

50% 

50% 

50% 

Temp  from  Max  Limit 

lO'C 

ICC 

ICC 

•  Wirewound  Power 

Power  Dissipation 

50% 

50% 

50% 

Temp  from  Max  Limit 

125*C 

125'C 

125®C 

•  Thick/Thin  Rim 

Power 

50% 

50% 

50% 

Voltage 

75% 

75% 

75% 

Max  Operating  Temp 

eo'C 

SO'C 

8CC 

Transistors  (Power) 

•  Silicon  Bipolar 

Power  Dissipation 

50% 

60% 

70% 

Vce,  Collector-Emitter 

70% 

75% 

80% 

Voltage 

Ic,  Collector  Current 

60% 

65% 

70% 

Breakdown  Voltage 

65% 

85% 

90% 

Max  Junction  Temp 

95'C 

125‘’C 

135''C 

•  GaAsMESFET 

Power  Dissipation 

50% 

60% 

70% 

Breakdown  Voltage 

60% 

70% 

70% 

Max  Channel  Temp 

85'»C 

lOO^C 

125»C 

•  Silicon  MOSFET 

Power  Dissipation 

50% 

65% 

75% 

Breakdown  Voltage 

60% 

70% 

75% 

Max  Junction  Temp 

95»C 

120'>C 

140'C 

42 


ROME  LABORATORY  RELIABILITY  ENGINEER’S  TOOLKIT 


DESIGN  -  TOPIC  D1 


Derating  Laval 

Part  Type 

Deratina  Paramater 

1 

II 

IH 

Transistors  (RF  Pulse) 

•  Silicon  Bipolar 

Power  Dissipation 

50% 

60% 

70% 

Vce,  Collector-Emitter 
Voltage 

70% 

70% 

70% 

tc  Collector  Current 

60% 

60% 

60% 

Breakdown  Voltage 

65% 

85% 

90% 

Max  Junction  Temp 

95“C 

125*C 

135*C 

•  GaAsMESFET 

Power  Dissipation 

50% 

60% 

70% 

Breakdown  Voltage 

60% 

70% 

70% 

Max  Channel  Temp 

85°C 

100°C 

125‘’C 

Transistors  (Thyristors) 

•  SCR&TRIAC 

On-State  Current 

50% 

70% 

70% 

Off-State  Voltage 

70% 

70% 

70% 

Max  Junction  Temp 

95°C 

105°C 

125“C 

Tubes 


Power  Output 

80% 

80% 

80% 

Power  Reflected 

50% 

50% 

50% 

Duty  Cycle 

75% 

75% 

75% 

Rotating  Devices 


Bearing  Load 

75% 

90% 

90% 

Temp  from  Max  Limit 

40°C 

25'’C 

15*C 

Surface  Acoustic  Wave  Device  (SAW) 

Input  Power  from  Max  Limit 
(Freq  >  500  MHz) 

13dBm 

13dBm 

13dBm 

Input  Power  from  Max  Limit 
(Freq  <  500  MHz) 

18dBm 

18dBm 

18dBm 

Operating  Temperature 

125°C 

125°C 

125°C 

Switches 


Resistive  Load  Current 

50% 

75% 

75% 

Capacitive  Load  Current 

50% 

75% 

75% 

Inductive  Load  Current 

35% 

40% 

40% 

Contact  Power 

40% 

50% 

50% 
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Topic  D2:  TharfiMil  Design 

One  of  the  important  variables  in  system  reliability  is  temperature.  Therefore,  the 
thermal  design  of  a  system  must  be  planned  and  evaluated.  Full  discussion  of  this 
topic  is  beyond  the  scope  of  this  document  but  it  is  important  to  point  out  to  a 
reliability  engineer  what  limitations  there  are  for  common  thermal  design 
approaches.  Table  D2-1  summarizes  fundamental  thermal  design  issues  which 
should  be  addressed  during  system  development.  Table  D2'2  summarizes  the 
most  common  cooling  techniques  for  electronics  and  their  limitations.  Analysis 
Topic  A14  provides  a  basic  method  of  estimating  microcircuit  junction  temperatures 
for  these  cooling  techniques. 

Table  D2-1 :  Thermal  Design  Issues 

Issue _ Concern _ 

•  Thermal  Requirements:  Has  a  if  not  specified,  a  formal  analysis 

thermal  analysis  requirement  been  probably  will  not  be  performed  and 

incorporated  into  the  system  there  will  be  no  possibility  of 

specification?  independent  review. 


•  Cooling  Allocation:  Has  cooling  Cooling  allocatbns  should  be  made  to 

been  allocated  down  to  each  the  box  level  (or  bebw)  and  refined  as 

subsystem,  box  and  LRU.  the  thermal  design  matures. 

•  Preliminary  Thermal  Analysis:  This  usually  represents  the  worst  case 

Has  a  preliminary  analysis  been  because  manufacturers  specify 

performed  using  the  manufacturer's  maximum  power  dissipatbns. 
specHbations  for  power  outputs? 

•  Detailed  Thermal  Analysis:  Has  The  prelirninary  analysis  needs  to  be 

a  detailed  analysis  been  performed  refined  using  actual  power  dissipations, 
using  actual  power  dissipatbns?  Results  need  to  feed  into  reliability 

predictions  and  derating  analysis. 

•  Thermal  Analysis  Assumptions: 

Have  junctbn-to-case  thermal  Optimistb  values  can  have  a  significant 
resistance  values  been  fully  effect  on  results.  Thermal  resistances 

justified?  from  MIL-M-38510  should  be  used 

unless  other  values  are  justified. 

Does  the  thermal  analysis  make  Junction-to-ambient  values  should  not 

use  of  junction-to-ambient  be  used  since  they  are  highly 

thermal  resistances?  dependent  on  coolant  fbw  conditbns. 

Are  all  modes  and  paths  of  heat  The  three  modes  are  convection, 

transfer  considered  in  the  conduction,  and  radiatbn.  Rationale 

analysis?  should  be  provided  for  omitting  any 

heat  transfer  modes  or  paths. 
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Table  D2-2:  Cooling  Technique  Limitations 

Cooling  Techniquo  Maximum  Cooling 

Capacity 

Description 

Impingement 
FrM  Convection 


Circuit  Cards 

.5  W/in2 

Well  Ventilated  Box 

300  W/ft3 

Poorly  Ventilated  Box 

100  W/ft* 

Forced  Air 

Circuit  Cards 

2  W/in2 

Box 

lOOOW/ft® 

Cokiwall 

1  W/in2 

Flow-Through 


Example:  A  9"  x  5"  printed  circuit  board  using  free  convection  cooling  would  be 
limited  to  about  22.5  watts. 
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Topic  D3:  Parts  Control 

Managing  a  parts  control  program  is  a  highly  specialized  activity  and  does  not 
typically  fail  under  the  system's  R&M  engineer's  responsibility.  However,  because 
of  the  interrelationship  of  parts  control  and  good  system  reliability,  it  is  important 
that  R&M  engineers  and  program  managers  have  a  general  understanding  of  the 
parts  control  discipline.  Parts  control  questions  which  are  often  asked  include: 

•  Why  do  parts  control? 

•  What  are  the  various  “tools'*  to  accomplish  parts  control? 

•  What  Is  a  military  specification  "Mil-Spec"  qualified  part,  a  MIL-STD-883 
part,  a  Standard  Military  Drawing  (SMD)  part,  and  a  vendor  equivalent 
part? 

Why  do  parts  control?  Since  the  invention  of  semiconductors,  users  could  never 
be  sure  that  a  device  purchased  from  one  manufacturer  would  be  an  exact 
replacement  for  the  same  device  obtained  from  another  supplier.  Major  differences 
in  device  processing  and  electrical  testing  existed  among  suppliers.  Because  of  the 
importance  of  semiconductors  to  military  programs,  the  government  introduced 
standard  methods  of  testing  and  screening  devices  in  1968.  Devices  which  were 
tested  and  screened  to  these  methods  were  then  placed  on  a  government  approval 
list  called  the  qualified  parts  list  (QPL).  Through  this  screening  and  testing  process, 
a  part  with  known  quality  and  performance  characteristics  is  produced.  The 
philosophy  for  assuring  quality  product  has  evolved  since  1968  and  now  there  are 
two  methodologies  in  place,  the  original  QPL  program  and  the  new  Qualified 
Manufacturer's  List  (QML)  program  (established  1985).  The  QML  approach  defines 
a  procedure  that  certifies  and  qualifies  the  manufacturing  processes  and  materials 
of  potential  vendors  as  opposed  to  the  individual  qualification  of  devices  (QPL). 
Hence,  all  devices  produced  and  tested  using  the  QML  certified/qualified 
technology  flow  are  qualified  products.  Part's  technology  flows  qualified  to  this 
system  are  listed  on  the  Qualified  Manufacturer's  List.  Both  Hybrids  as  well  as 
monolithic  microcircuits  are  covered  under  this  system. 

What  are  the  various  "tools"  to  accomplish  parts  control?  The  government 
has  subdivided  parts  into  three  basic  classifications:  (1)  microelectronics,  (2) 
semiconductors  (e.g.  transistors,  diodes,  etc.)  and  (3)  electrical  parts  (e.g.  switches, 
connectors,  capacitors,  resistors,  etc.).  For  each  class,  part  specification  and  test 
method  documents  have  been  developed.  Table  D3-1  summarizes  key  documents 
and  their  content. 

What  is  a  military  specification  "Mil-Spec"  qualified  part,  a  MIL-STD-883  part, 
a  Standard  Military  Drawing  (SMD)  part,  and  a  vendor  ^uivalent  part?  The 

primary  difference  in  these  descriptions  is  that  each  of  these  part  classes  has 
undergone  different  levels  of  screening  and  certification.  Certification  involves 
specifying  and  documenting  the  part  manufacturing  process.  It  also  involves 
government  and  manufacturer  agreement  on  a  detailed  part  specification.  This 
ensures  consistent  part  quality  and  known  performance.  Table  D3-2  summarizes 
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common  classes  of  parts  and  what  these  classifications  signify.  Table  D3-3 
summarizes  MIL-STD-8830  screening  procedures  and  is  included  to  give  the 
reader  a  feel  for  the  wide  range  of  tests  required.  These  screening  requirements 
are  similar  for  the  respective  systems  defined  in  Table  03-2.  Topic  A11,  Table 
A1 1-1  shows  the  impact  of  the  various  part  designations  on  system  reliability. 


Table  D3-1 :  Key  Parts  Control  Documents  and  Their  Content 


Document  Title 


Content 


MIL-M-38510 


General  Specification 
for  Microcircuits 


MIL-l-38535 


General  Specification 
for  Integrated  Circuits 
(Microcircuits) 
Manufacturing 


Provides  detailed  specification  requirements 
in  the  form  of  ‘slash  sheets*  for  several 
hundred  of  the  most  commonly  used 
microcircuits.  Covers  screening  requirements 
(referenced  to  MtL-STD-883),  electrical 
testing,  quality  conformance,  physical 
dimensions,  configuration  control  for  critical 
manufacturing  processing  steps  and 
production  line  certification. 

Provides  detailed  specification  requirements 
in  the  form  of  standard  military  drawings 
(SMDs).  Quality  assurance  requirements 
are  defined  for  all  microcircuits  built  on  a 
manufacturing  line  which  is  controlled 
through  a  manufacturer's  quality  manage¬ 
ment  program  and  has  been  certified  and 
qualified  in  accordance  with  the  require¬ 
ments  specified.  The  manufacturing  line 
must  be  a  stable  process  flow  for  all 
microcircuits.  Two  levels  of  product 
assurance  (including  radiation  hardness 
assurance)  are  provided  for  in  this 
specification,  avionics  and  space.  The 
certification  and  qualification  sections 
specified  outline  the  requirements  to  be  met 
a  manufacturer  to  be  listed  on  a  Qualified 
Manufacturer's  List  (QML).  After  listing  of  a 
technology  flow  on  a  QML,  the  manufacturer 
must  continually  meet  or  improve  the 
established  baseline  of  certified  and  qualified 
procedures  through  his  quality  management 
program  and  the  technok^y  review  board. 
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Document 

THIe 

Content 

MIL-H-38534  General  Sp^ification 
for  Hybrid  Microcircuits 


Provides  detailed  specification  requirements 
in  the  form  of  Standard  Military  Drawings 
(SMDs)  for  standard  hybrid  pn^ucts,  and 
Source  Control  Drawings  (SCDs)  using  the 
SMD  boilerplate  for  custom  hybrids.  Cwers 
requirements  for  screening  (referenced  to 
MIL-STD-883)  quality  conformance 
inspections,  configuration  control,  rework 
limitations  and  manufacturing  line 
certification  procedures. 


MIL-STD-883  Test  Methods  and 
Procedures  for 
Microelectronics 


Provides  uniform  methods  and  procedures 
for  testing  microelectronic  devices. 
Structured  into  five  classes  of  test  methods: 
1000  class  addresses  environmental  tests, 
2000  class  addresses  mechanical  tests, 
3000  class  addresses  electrical  tests  for 
digital  circuits,  4000  class  addresses 
electrical  tests  for  linear  circuits,  and  5000 
class  addresses  test  procedures.  The  tests 
covered  include  moisture  resistance,  seal 
test,  neutron  irradiation,  shock  and 
acceleration  tests,  dimensional  tests, 
input/output  current  tests,  and  screening  test 
procedures  to  name  a  few.  Two  test  levels 
are  described;  Class  B  (Class  H,  MIL-H- 
38534/Class  Q,  MIL-l-38535)  and  Class  S 
(Class  K,  MIL-H'38534/Class  V,  MIL-l- 
38535).  Class  S  is  geared  toward  space 
qualified  parts  and  requires  a  host  of  tests 
rK>t  performed  on  Class  B  parts  (e.g.  wafer 
bt  acceptance,  100%  nondestructive  bond 
pull,  particle  impact  noise  detection, 
serialization,  eta). 


MIL-S-1 9500  General  Specif icatbn 
for  Semiconductors 


Provides  detailed  specification  sheets 
establishing  general  and  specific 
requirements  including  electrical 
characteristics,  mechanical  characteristics, 
qualification  requirements,  inspection 
procedures  and  test  methods. 
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Documant  Titia 


MIL-STD-750  Test  Methods  for 

Semiconductor  Devices 


MIL-STD-202  Test  Methods  for 

Electronic  and  Electrical 
Parts 


MIL-STD-965  Parts  Control  Program 


Content 


Provides  uniform  methods  and  procedures 
for  testing  semiconductors.  Structured  into 
five  classes  of  test  methods:  1000  class 
addresses  environmental  tests,  2000  class 
addresses  mechanical  characteristics,  3000 
class  addresses  electrical  characteristics, 
3100  dass  addresses  circuit  performance 
and  thermal  resistance  measurements,  and 
the  3200  class  addresses  low  frequency 
tests. 

Provides  uniform  methods  for  testing 
electronic  and  electrical  parts.  Structured 
into  three  classes  of  test  methods:  1 00  dass 
addresses  environmental  tests,  200  dass 
addresses  physical  characteristic  tests  and 
300  class  addresses  eledrical  charaderistic 
tests.  These  tests  are  not  tied  to  a  single 
part  specification  document  as  with 
microeledronics  and  semicondudors,  but 
rather,  numerous  specifications  for  various 
component  types. 

Provides  control  procedures  to  be  used  in 
the  design  and  development  of  military 
equipment,  including  the  submission,  review 
arid  approval  of  a  Program  Parts  Seledion 
List.  Generally,  an  overall  guide  for  the 
implementation  and  management  of  a  parts 
control  program.  The  document  provides  for 
two  basic  management  procedures. 
Procedure  I  is  applicable  to  a  majority  of 
programs  and  does  nd  make  use  of  a  formal 
parts  control  board.  Procedure  II  requires  a 
formal  parts  control  board  and  is 
recommended  for  consideration  where  there 
is  an  aggregation  of  contractor/ 
subcontradors. 
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Table  D3-2:  Microelectronics  Classifications  and  Descriptions 


Part  Classification  Part  Classification  Daacriptlon 


JANor  MIL-M-38510  Parts  These  parts  have  a  detailed  specification  (slash 

sheet)  in  MIL-M-38510  which  controls  all 
mechanical,  electrical,  and  functional  parameters 
of  the  part.  Additionally,  the  manufacturing 
process  flow  is  certified  by  DoD's  Defense 
Electronics  Supply  Center  (DESC),  the  devices  are 
screened  to  MIL-STD-883  test  method 
requirements,  and  are  subjected  to  rigorous  quality 
conformance  testing.  A  manufacturer,  once 
certified  by  DESC,  can  then  qualify  products  to  the 
specification  and  have  these  products  listed  on  the 
qualified  products  list.  The  product  specification 
(performance  and  mechanical)  is  contained  in  a 
M3851 0/0000  'slash  sheet*  or  one  part  number 
SMD.  Standardization  is  achieved  through  many 
manufacturers  building  product  to  the  same  'one 
part  SMD*  or  'slash  sheet*  and  testing  them  using 
the  standard  test  methods  found  in  MIL-STD-883. 


QML  (Qualified  Manufacturers  Listing)  Device  performance  requirements  (electrical, 
or  MIL-l-38535  Parts  thermal,  and  mechanical)  are  detailed  in  the 

Standard  Military  Drawing  (SMD).  The  qualifying 
activity  or  its  agent  certifies  and  qualifies  the 
manufacturers  process  flows.  Once  certified  and 
qualified,  the  manufacturer  may  produce  multiple 
device  types  on  that  flow  as  MIL-l-38535  compliant 
parts.  Since  the  process  is  considered  qualified, 
individual  products  do  not  have  to  be  qualified 
individually  for  selected  quality  conformance 
inspections,  except  Class  V  (Space)  product. 
Where  standard  tests  are  used  by  the 
manufacturer  to  qualify  the  process,  the  use  of 
American  Society  for  Testing  and  Materials 
(ASTM),  MIL-STD-883  or  Joint  Electron  Device 
Engineering  Council  (JEDEC)  specifications  are 
suggested.  The  manufacturer  may  also  document 
and  use  new  tests  developed  to  improve  quality 
and  reliability.  Manufacturers  are  required  to 
identify  a  Technical  Review  Board  (TRB)  within 
their  company.  It  is  the  duty  of  the  TRB  to  approve 
all  changes  in  the  process  and  report  to  DESC  on 
a  regular  basis.  Changes  in  the  process  and 
products  are  reviewed  annually  by  a  team  of  users, 
the  qualifying  activity  and  the  preparing  activity. 
Progress  in  meeting  company  established  yield, 
Statistical  Process  Control  (SPC),  and  reliability 
goals  are  reported  at  this  meeting.  Parts  produced 
under  MIL-l-38535  are  listed  on  the  QML. 
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Part  ClasaHIcation  Part  Ctaaaificatlon  Daacriptlon 


QML  (Hybrids)  /  CH  or  MIL-H-38534  The  requirements  for  a  hybrid  microcircuit  are  set 

Parts  forth  in  Standard  Military  Drawings  (SMDs)  or 

Source  Control  Drawings  (SCDs).  The  qualifying 
activity  qualifies  the  manufacturer's  process  flows 
and  once  certified  and  qualified  may  produce 
multiple  device  types  on  that  flow  as  MtL-H-38534 
compliant  parts.  Test  methods  are  defined  in  MIL- 
STD-883.  All  major  changes  to  the  process  flows 
require  qualifying  activity  approval.  Parts  produced 
under  this  system  are  listed  in  the  Qualified 
Manufacturer’s  List. 

Standard  Military  Drawing  (Class  M)  This  system  evolved  from  various  manufacturer's 

and  MIL-STD-883  Compliant  Devices  in-house  versions  of  Test  Methods  5004  and  5005 

of  MIL-STD-883.  It  was  an  informal  and 
inconsistent  system  in  the  late  70's  and  early  80’s 
known  as  MIL  equivalent,  or  look  alikes. 
Manufacturers  were  falsely  advertising  these  parts 
as  equivalent  to  JAN  parts,  without  basis,  because 
most  critical  JAN  requirements  (e.g.  audits, 
qualification,  quality  conformance  inspection  tests) 
were  not  followed.  In  some  cases,  not  all  the 
required  JAN  testing  was  being  performed  by  the 
manufacturer.  This  resuhed  in  the  government 
incorporating  a  truth  in  advertising  paragraph  in 
MIL-STD-883  (i.e.  Paragraph  1.2.1).  This  required 
the  manufacturer  to  self-certify  that  all  1.2.1 
requirements,  a  subset  of  the  MIL-M-38510 
requirements,  were  being  met  if  advertised  as 
meeting  MIL-STD-883  requirements.  DESC  has 
begun  an  audit  program  to  verify  the 
manufacturers  self  compliance  to  MIL-STD-883, 
Paragraph  1.2.1  compliant  product.  The  primary 
difference  between  Standardized  Military  Drawing 
(SMD)  product  and  MIL-STD-883  compliant 
product  is  that  SMD  (Class  M)  sources  are 
approved  by  the  Defense  Electronics  Supply 
Center  (DESC).  DESC  manages  the  procurement 
document  (SMD)  and  approves  the  sources  by 
accepting  their  certificate  of  compliance  to  the 
Paragraph  1.2.1  requirements.  The  MIL-STD-883 
compliant  product  is  produced  to  uncontrolled 
vendor  data  books  and  the  government  has  no 
control  over  compliancy  claims.  Certification  and 
qualification  by  DESC  is  not  required  for  either 
system. 
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Part  Classification 

Part  Classification  Description 

Vendor  Equivalent  Parts  Each  parts  supplier  has  a  set  of  commercial 

specifications  which  they  use  for  manufacturing 
product  for  general  sale.  Usually  the  product 
specifications  are  included  on  a  data  sheet  which 
is  then  collected  into  a  catalog  for  sale  to  the 
general  public.  There  is  a  wide  spectrum  of  quality 
available  depending  on  the  quality  standards 
applied  by  the  company.  Generally,  these  parts 
have  been  tested  to  the  vendor's  equivalent  MIL- 
STD-883  test  methodology.  The  vendor  may  or 
may  not  modify  the  scope  of  the  tests  and  a  careful 
analysis  is  required  to  determine  how  similar  the 
vendor's  tests  are  to  MIL-STD-883  tests. 
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Topic  D4:  Review  Questions 

Program  and  design  reviews  are  key  vehicles  for  measuring  development  progress 
and  preventing  costly  redesigns.  Participation  by  government  individuals 
knowledgeable  in  R&M  is  critical  to  provoking  discussions  that  bring  out  the  issues 
important  to  R&M  success.  Of  course,  the  questions  to  be  posed  to  the 
development  contractor  depend  on  the  timing  of  the  review  as  indicated  below. 
Action  Items  should  be  assigned  at  the  reviews  based  on  open  R&M  issues  and  the 
reliability  engineer  must  follow-up  to  ensure  that  they're  resolved  satisfactorily. 

Table  D4-1:  Major  Program  Reviews 


Review 


System 
Requirements 
Review  (SRR) 


Preliminary 

Design 

Review  (PDR) 


Critical  Design 
Review  (CDR) 


Test  Readiness 
Review  (TRR) 


Production 
Readiness 
Review  (PRR) 


Purpose 

To  ensure  a  complete 
understanding  of  system 
specification  and  statement  of  work 
requirements.  This  is  usually  done 
by  means  of  a  detailed  expansion 
and  review  of  the  contractor's 
technical  proposal. 


To  evaluate  progress  and  technical 
adequacy  of  the  selected  design 
approach  prior  to  the  detailed 
design  process. 


To  ensure  that  the  detailed  design 
satisfies  the  requirements  of  the 
system  specification  before  freezing 
the  design  for  production  or  field 
testing. 


To  ensure  that  all  CDR  problems 
have  been  satisfactorily  resolved 
and  to  determine  if  the  design  is 
mature  enough  to  start  formal 
testing. 

To  review  test  results  and 
determine  whether  or  not  the 
design  is  satisfactory  for 
production. 


R&M  Engineers  Role 

Discuss  the  performance  of  all 
required  R&M  tasks  and 
requirements  with  contractor  R&M 
personnel.  Topics  such  as  the 
contractor's  overall  reliability 
program  plan,  data  items  and 
delivery  schedule  are  usually 
discussed. 

Review  preliminary  R&M  modeling, 
allocations  and  predictions  to 
ensure  adequacy  in  meeting  R&M 
requirements.  Discuss  status  of 
other  R&M  tasks  such  as  parts 
control,  derating,  thermal  design 
and  reliability  critical  items. 

Review  the  final  reliability  analysis 
and  modeling  to  ensure  R&M 
requirements  are  met.  Discuss 
parts  control  program  status  and 
military  part  procurement  lead  time 
requirements.  Review  adequacy  of 
the  final  thermal  analysis  and 
derating.  Discuss  R&M  testing. 

Review  R&M  test  plans  and 
procedures  to  ensure  acceptable 
ground  rules  and  compliance  with 
requirements. 


Discuss  R&M  testing  results  and 
ensure  any  design  deficiencies 
found  during  testing  have  been 
corrected.  Discuss  production 
quality  assurance  measures. 
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Table  D4-2:  Deaign  Review  Checklist 


ftevitw  WlMT*  Iteually 
Most  Appilcsbto 

OuMtlon  SRR  FOR  COR  TRR  PRR  RMnarks 


R&M  Management 

What  are  the  avenues  of  X  X 
technical  interchange 
between  the  R&M  group  and 
other  engineering  groups 
(e.g.,  Design,  Systems 
Engineering,  ILS, 
Procurement,  and  Test  and 
Evaluation)? 


R&M  engineering  should 
participate  at  all  engineering 
group  meetings  where  R&M 
is  effected.  Easy  avenues  of 
technical  interchange 
between  the  electrical  design 
group  and  other  groups  su^ 
as  thermal  engineering  must 
exist 


Does  the  reliability  group  X  X 
have  membership  and  a 
voice  in  decisions  of  the 
Material  Review  Board, 

Failure  Review  Board,  and 
Engineering  Change 
Review  Board? 


X  X  Membership  or  an  option  to 

voice  an  opinion  is  essential 
if  the  failure  tracking  and 
conective  action  loop  is  to  be 
completed. 


Is  the  contractor  and  XXX 

subcontractor(s)  a  member  of 

the  Government  Industry 

Data  Exchange  Program 

(GIDEP)?  What  is  the 

procedure  for  comparing 

parts  on  the  ALERT  list  to 

parts  used  in  the  system? 


Incoming  part  types  should 
be  checked  against  the 
GIDEP  ALERT  data  base 
and  incoming  ALERTS 
should  be  checked  against 
the  system  parts  list.  (GIDEP 
ALERTS  are  notices  of 
deficient  parts,  materials  or 
processes). 


Are  reliability  critical  items  X  X 

given  special  attention  in  the 
form  of  special  analysis, 
testing  or  destructive 
laboratory  evaluation? 


Do  the  purchase  orders  X  X 
require  vendors  to  deliver 
specified  levels  of  R&M&T 
based  on  allocation  of  higher 
level  requirements? 


Critical  parts  are  usually 
defined  by  contract  or  by 
MIL-STD-785.  Methods  of 
tracking  critical  parts  must  be 
identified  by  the  contractor. 
See  Topic  D5  for  a  critical 
items  checklist. 

Requirements  should  include 
verification  by  analysis  or 
test. 


56 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


DESIGN  -  TOPIC  D4 


QiMStion 


Does  the  reliability  group 
have  access  to  component 
and  faiiure  analysis  experts 
and  how  are  they  integrated 
into  the  program? 


Is  there  adequate  X 
communication  between 
testabiiity  design  engineers 
and  the  eiectricai  design 
group  to  ensure  that 
testabiiity  considerations  are 
worked  into  the  upfront 
design? 

Are  JAN  microcircuits  (MiL- 
M-38S10  or  MIL-l-38535)  and 
semiconductors  (MIL*S< 
19500)  being  used  wherever 
possibie  and  are 
procurement  lead  times  for 
these  devices  adequate? 


Review  Where  Ueually 

Most  Applicable 

SRR  PDR  CDR  TRR  PRR 


XXX 


Where  nonstandard  parts  are 
used,  are  they  procured  via  a 
specification  control  drawing 
(SCO)  and  do  they  have  at 
least  two  suppliers?  Are 
methods  for  nonstandard  part 
approval  clearly  established 
and  is  there  a  clear 
understanding  of  what 
constitutes  a  standard  and 
nonstandard  part? 

Has  an  up-to-date  preferred 
parts  selection  list  (PPSL) 
been  established  for  use  by 
designers? 


X  X 


Ramarks 


Failure  analysis  is  essential 
to  determine  the  cause  and 
effect  of  failed  components. 


Part  quality  in  order  of 
preference;  MIL-M-38510,  or 
MIL-l-38535  devices;  MIL- 
STD-883  Class  B;  MIL-STD- 
883  vendor  equivalent; 
commercial  hermetically 
sealed.  JAN  parts  usually 
require  longer  procurement 
times  (3  to  6  months)  which 
sometimes  causes 
commercial  parts  to  be 
forced  into  the  design. 

Specification  control 
drawings  should  specify 
reliability,  environment  and 
testing  requirements. 


DESC  and  DISC  establish 
baseline  PPSLs  which  should 
be  the  basis  of  the 
contractor’s  list. 
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Question 

Review  Where  Usually 

Most  Applicable 

SRR  POR  COR  TRR  PRR  Remarks 

R&M  Design 


Do  the  R&M&T  models  X  X 

accurately  reflect  the  system 
configuration,  its  modes  of 
operation,  duty  cycles,  and 
implementation  of  fault 
tolerance? 

Do  predictions  meet  XXX 

numerical  R&M  specification 
requirements?  Are  prediction 
procedures  in  accordance 
with  requirements? 

Have  R&M  allocations  been  X  X 
made  to  the  LRU  level  or 
below?  Do  reliability  pre¬ 
dictions  compare  favorably  to 
the  allocation? 

Does  the  testability  analysis  X  X 

show  that  numerical 

testability  requirements  will 

be  met  for  the  organizational, 

intermediate  and  depot  repair 

levels? 

Have  tradeoff  studies  been  X  X 

performed  in  the  areas  of 
R&M&T? 


Has  a  thermal  analysis  been  X  X 

performed  to  ensure  an 

adequate  cooling  technique 

is  used  and  have  the 

temperature  results  been 

factored  into  the  reliability 

analysis? 

Has  piece  part  placement  X  X 

been  analyzed  to  ensure  that 
high  dissipating  parts  are 
placed  away  from  heat 
sensitive  parts? 


If  not,  better  cooling,  part 
quality  and/  or  redundancy 
should  be  considered. 


Weighted  reliability  allo¬ 
cations  should  be  made  to 
lower  levels  based  on  the 
upper  test  MTBF  (Oo)>  of 
similar  measure. 

If  not,  alternate  design 
concepts  must  consider 
including  more  automated 
features. 


Typical  tradeoffs  might 
include  redundancy  levels, 
weight,  power,  volume, 
complexity,  acquis'rt'ion  cost, 
life  cycle  cost. 

Thermal  analysis  is  essential 
to  a  complete  program. 


For  example,  high  power 
dissipation  components  such 
as  large  power  resistors, 
diodes  and  transformers 
should  be  investigated. 
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Qucetlon 

Review  Where  Usually 

Most  Applicable 

SRR  POR  COR  TRR  PRR  Remarks 

Have  methods  been  X  X 
established  to  ensure  that 
operating  temperatures  of 
off-the-shelf  ^uipment  will 
be  within  specified  limits? 


Reference  environmental 
requirements  in  the  system 
sp^ication. 


Do  parts  used  in  the  design  X 

meet  system  environmental 
requirements? 


Is  there  a  clearly  established  X  X 
derating  criteria  for  all  part 
types  used  in  the  design  and 
is  there  a  clear  procedure  for 
monitoring  and  enforcing  this 
criteria? 


X  Temperature  range  for  most 

military  parts  is  -  SS^’C  to  + 
125*0.  Temperature  range 
for  most  commercial  parts 
(plastic)  is  0®C  to  70*0. 

X  The  part  derating  levels  are  a 

function  of  program  type  but 
should  be  at  least  Level  III  in 
Topic  D1. 


Are  temperature  overheat  X  X 

sensors  includeJ  in  the 
system  design? 

Is  there  a  clear  procedure  for  X  XX 
the  identification  of  parts  not 
meeting  the  derating  criteria? 


Will  part  derating  verification  X 

tests  be  performed? 


Have  limited  life  parts  and  X  X 

preventive  maintenance 
tasks  been  identified,  and 
inspection  and  replacement 
requirements  specified? 


A  tradeoff  analysis  should  be 
performed  on  parts  not 
meeting  derating  criteria  to 
determine  if  a  redesign  to 
lower  stress  is  appropriate. 

Depending  on  system 
criticality,  3  to  7  percent  of 
the  system's  parts  should 
undergo  stress  verification. 
No  more  than  30  percent  of 
the  tested  parts  should  be 
passive  parts  (resistors, 
capacitors,  etc.). 

For  example,  inspection 
items  may  include  waveguide 
couplers,  rotary  joints, 
switches,  bearings,  tubes 
and  connectors.  Typical 
Preventive  Maintenance 
(PM)  items  include  air  filters, 
lubrication,  oil  changes, 
batteries,  belts,  etc. 
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Quaatlon 

Review  Where  Usually 
Most  Applicabie 

SRR  POR  CDR  TRR  PRR 

Remarks 

Have  single  points  of  failure 
been  identified,  and  their 
effects  determined? 

X  X 

Important  for  identifying 
areas  where  redundancy 
should  be  implemented  and 
to  assist  in  ranking  the  most 
serious  failure  modes  for 
establishing  a  critical  items 
list. 

Have  compensating  features  X 

been  identified  for  those 
single  points  of  failure  where 
complete  elimination  of  the 
failure  mode  is  impractical? 

Hava  areas  where  fault  X 

ambiguity  may  exist  been 
identified?  Hava  alternative 
methods  of  isolation  and 
checkout  (e.g.,  semi¬ 
automatic,  manual,  repetitive 
replacement,  etc.)  been 
identified  for  these  areas? 

For  each  maintenance  level,  X 

has  a  decision  been  made  for 
each  item  on  how  built-in¬ 
test,  automatic  test 
equipment,  and  general 
purpose  electronic  test 
equipment  will  support  fault 
detection  and  isolation? 

Are  features  being  X 

incorporated  into  the 
testability  design  to  control 
false  alarms? 


R&M  Testing 

Is  there  a  failure  reporting 
and  corrective  action  system 
(FRACAS)  in  place,  and  does 
it  account  for  failures 
occurring  during  all  phases  of 
testing? 


X  Compensating  features  could 

include  increased  part 
quality,  increased  testability, 
additional  screening,  fail  safe 
design  provisions,  etc. 

X  Additional  test  nodes  must  be 

considered  to  break 
ambiguity  groups. 


X 


X  Typical  features  might 

include  definition  of  test 
tolerances,  transient  monitor¬ 
ing  and  control,  multiple  run 
decision  logic,  environmental 
effects  filtering  and 
identification,  etc. 


XXX  FRACAS  should  include  data 
from  incoming  inspection, 
development  testing,  equip¬ 
ment  integration  testing  and 
R&M  testing.  FRACAS 
should  be  'closed  loop” 
emphasizing  corrective 
action. 
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QUMtkMI 


Is  there  a  failure  analysis 
capability  and  wilt  failures  be 
subjected  to  a  detailed 
analysis? 

Are  subcontractors  subjected 
to  the  same  FRACAS 
requirements,  and  will  their 
failure  analysis  reports  be 
included  with  the  prime 
contractor's  reports? 

Does  the  reliability  demon¬ 
stration  test  simulate  the 
operating  profile  seen  in  the 
field  and  will  all  modes  of 
equipment  operation  be 
tested  over  the  required 
environmental  extremes? 

Does  the  maintainability  and 
testability  demonstration  test 
simulate  realistic  failures  and 
is  the  candidate  task  list 
sufficient  to  reduce  bias? 


Review  Where  Usually 

Most  Appllcabis 

SRR  POR  COR  TRR  PRR 


XXX 


X  X 


X  X 


Rwnarks 


Contractor  should  identify 
criteria  used  to  determine 
which  failures  will  be 
analyzed. 


The  test  must  simulate  the 
operational  profile  and 
modes  to  have  valid  results. 


Candidate  lists  should  be 
four  to  ten  times  the  size  of 
the  test  sample. 


Are  relevant  and  nonrelevant 
failure  definitions  clear  and 
agreed  upon? 

Are  equipment  performance 
checks  to  be  performed 
during  testing  clearly  defined 
and  has  the  information  to  be 
recorded  in  the  test  log  been 
clearly  defined  and  agreed 
upon? 

Do  preliminary  plans  for  ESS 
meet  the  required  needs? 


X  X  Topic  T9  for  failure 

definitions. 


X  Items  such  as  temperature 

variations,  start/stop  of 
vibration,  event  occurrence 
times  and  a  detailed  des¬ 
cription  of  system  recovery 
after  failure  should  be 
included  as  a  minimum. 

X  X  Temp,  and  random  vibration 
are  the  most  effective 
screens.  At  module  level, 
perform  20  to  40  temp, 
cycles  per  module.  At  higher 
assembly  levels,  perform  4  to 
20  cycles.  (See  RADC-TR- 
86-149,  "ESS"  and  DOD- 
HDBK-344.  "Environmental 
Stress  Screening  of  Elect¬ 
ronic  Equipment,"  and  Topics 
T1 -T3  for  guidance). 
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Topic  D5:  Critical  Itom  Checklist 

Major  Concams  Comments 


Has  the  contractor  developed 
formal  policies  and  procedures  for 
identification  and  control? 

Are  the  procedures  implemented  at 
the  initial  design  stage  and  do  they 
continu  >  through  final  acceptance 
period? 

Are  periodic  reviews  planned  to 
update  the  list  and  controls? 

Has  an  FMEA  been  performed  on 
each  critical  item? 


Are  compensating  features 
included  in  the  design? 


Does  the  contractor's  control  plan 
eliminate  or  minimize  the  reliability 
risk? 


As  a  minimum,  are  the  following 
criticality  factors  considered: 

-  Failures  jeopardizing  safety 

-  Restrictions  on  limited  useful  life 

-  Design  exceeding  derating  limits 

-  Single  sources  for  parts 

-  Historically  failure  prone  items 

-  Stringent  tolerances  for 
manufacturing  or  performance 

-  Single  failure  points  that  disrupt 
mission  performance 


Policies  should  be  distributed  to 
design,  manufacturing,  inspection 
and  test  personnel. 

The  program  has  to  start  early  so 
that  safety  related  items  can  be 
minimized. 


Reviews  at  SRR,  PDR,  and  CDR 
must  be  considered. 

Failure  modes  need  to  be  identified 
so  that  control  procedures  can  be 
developed. 

Features  such  as  safety  margins, 
overstress  testing,  special 
checkouts  should  be  considered. 

Development  of  a  list  of  critical 
items  is  only  half  the  solution; 
controls  such  as  stress  tests, 
design  margins,  duty  cycles,  and 
others  must  be  considered. 

A  list  of  critical  items,  personnel 
responsible  for  monitoring  and 
controlling,  and  review  procedures 
must  be  established.  Other 
application  unique  critical  items 
should  be  identified  by  the 
procuring  activity. 
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Topic  D6:  Dormancy  Design  Controi 

Dormancy  design  control  is  important  in  the  life  cycle  of  a  weapon  system  because, 
after  an  equipment  has  been  installed  or  stored  in  an  arsenal,  the  predominant 
portion  of  its  life  cycle  is  in  the  dormant  mode.  The  main  problems  are  the  lack  of 
dormancy  related  design  guides  and  control  methods  to  maintain  or  assure  system 
reliability  in  storage.  Questions  often  asked  and  seldom  answered  are: 

•  Most  Important  stresses?  Mechanical,  chemical,  and  low  thermal;  the 
synergism  of  these  three  stresses  is  critical. 

•  Most  significant  failure  mechanisms?  Failures  related  to  latent 
manufacturing  defects,  corrosion ,  and  mechanical  fracture,  with  most  failures 
being  the  result  of  latent  manufacturing  defects  rather  than  specific  aging 
mechanisms. 

•  Types  of  failure?  Most  failures  that  occur  during  nonoperating  periods  are 
of  the  same  basic  kind  as  those  found  in  the  operating  mode,  though 
precipitated  at  a  slower  rate. 

•  Most  Important  factor?  Moisture  is  the  single  most  important  factor 
affecting  long  term  nonoperating  reliability.  All  possible  steps  should  be 
taken  to  eliminate  it  from  electronic  devices.  Hygroscopic  materials  should 
be  avoided  or  protected  against  accumulation  of  excess  moisture. 

•  Materials  to  avoid?  Avoid  materials  sensitive  to  cold  flow  and  creep  as  well 
as  metalized  and  non-metallic  finishes  which  have  flaking  characteristics. 
Avoid  the  use  of  lubricants;  if  required,  use  dry  lubricants  such  as  graphite. 
Do  not  use  teflon  gaskets  in  lieu  of  conventional  rubber  gaskets  or  better  yet, 
use  silicone  based  rubber  gaskets. 

Storage  Guidelines 

•  Do  not  test  the  equipment:  Periodic  testing  results  in  failures  rather  than 
higher  states  of  readiness.  Historical  data  on  missile  systems  that  were 
stored  and  tested  periodically  shows  that  failures  were  introduced  into  the 
equipment  as  a  result  of  the  testing  process.  Causes  of  the  failures  were  test 
procedures,  test  equipment  and  operator  errors.  Main  guidelines  are: 

-  Disconnect  ail  power 

-  Ground  all  units  and  components 

-  Pressurize  all  coax  waveguides:  Use  nitrogen  to  prevent  moisture  and 
corrosion. 

-  Maintain  temperature  at  50°F  +/-  sV:  At  least  drain  all  equipment  of 
water  to  prevent  freezing  or  broken  pipes. 
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-  Control  relative  humidity  to  50%  -f/*  5%:  Reduces  corrosion  and 
prevents  electrostatic  discharge  failure. 

-  Periodically  recharge  batteries 

-  Protect  against  rodents:  Squirrels  have  chewed  cables,  mice  have  nested 
in  electronic  cabinets  and  porcupines  have  destroyed  support  structures 
(wood).  Ooor/window  seals,  traps/poison  and  frequent  inspection  protect 
against  these  rodents. 

Protective  and  Control  Measures 

Materials 

>  Mechanical  items:  Use  proper  finishes  for  materials,  nonabsorbent 
materials  for  gasketing,  sealing  of  lubricated  surfaces  and  assemblies,  and 
drain  holes  for  water  run-off. 

•  Electronic  and  electrical  items:  Use  nonporous  insulating  materials, 
impregnate  cut  edges  on  plastic  with  moisture  resistant  varnish  or  resin,  seal 
components  with  moving  parts  and  perforate  sleeving  over  cabled  wire  to 
avoid  the  accumulation  of  condensation. 

•  Electromagnetic  Items:  Impregnation  of  windings  with  moisture  proof 
varnish,  encapsulation,  or  hermetic  sealing,  and  use  of  alumina  insulators. 

•  Thermal  items:  Use  nonhygroscopic  materials  and  hermetic  sealing. 

•  Finishes:  Avoidance  of  hygroscopic  or  porous  materials;  impregnate  all 
capillary  edges  with  wax,  varnish  or  resin. 

Parts 

•  Use  parts  with  histories  of  demonstrated  successful  aging. 

•  Use  only  hermetically  sealed  semiconductors. 

•  Do  not  use  semiconductors  and  microcircuits  that  contain  nichrome- 
deposited  resistors. 

•  Select  parts  that  use  mono-metallization  to  avoid  galvanic  corrosion. 

•  Do  not  seal  chlorine  or  other  halogen-containing  materials  within  any  circuitry 
components. 

•  Avoid  the  use  of  variable  resistors,  capacitors,  inductors,  or  potentiometers. 

•  Avoid  the  use  of  electromechanical  relays. 

•  Avoid  attachments  and  connections  that  depend  on  spring  action  for 
effectiveness. 
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Table  D6-1: 

Dormant  Part  Failure  Mechanisms 

Typ« 

Mechanism 

%  Failure  Mods 

Accelerating  Factor 

Microcircuit 

MOS 

Surface  Anomolies 

35-70  Degradation 

Moisture,  Temp. 

Wire  Bond 

10-20  Open 

Vibratbn 

Bipolar 

Seal  Defects 

10-30  Degradation 

Shock,  Vibration 

Wire  Bond 

15-35  Open 

Vibration 

Transistor 

Signal 

Contamination 

15-45  Degradation 

Moisture,  Temp. 

Header  Defects 

10-30  Drift 

Shock,  Vibration 

FET 

Contamination 

10-50  Degradation 

Moisture,  Temp. 

Corrosion 

15-25  Drift 

Moisture,  Temp. 

Diode 

Zener 

Header  Bond 

20-40  Drift 

Shock,  Vibration 

Corrosion 

20-40  Intermittent 

Moisture,  Temp. 

Signal 

Lead/Die  Contact 

15-35  Open 

Shock,  Vibration 

Header  Bond 

15-35  Drift 

Shock,  Vibration 

Resistor 

Film 

Corrosion 

30-50  Drift 

Moisture,Temp. 

Film  Defects 

15-25  Drift 

Moisture,Tamp. 

Wirewound 

Corrosion 

35-50  Drift 

Moisture,  Temp. 

Lead  Defects 

10-20  Open 

Shock,  Vibration 

Capacitor 

Ceramic 

Connection 

10-30  Open 

Temp.,  Vibration 

Corrosion 

25-45  Drift 

Moisture,  Temp. 

Tantalum 

Mechanical 

20-40  Short 

Shock,  Vibration 

Oxide  Defect 

15-35  Drift 

Temp.,  Cycling 

RF  Coil 

Lead  Stress 

20-40  Open 

Shock,  Vibration 

Insulation 

40-65  Drift 

Moisture,  Temp. 

Transformer 

Insulation 

40-80  Short 

Moisture,  Temp. 

Relay 

Contact  Resistance 

30-40  Open 

Moisture,  Temp. 

Contact  Corrosion 

40-65  Drift 

Moisture 
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Topic  D7:  Surface  Mount  Technology  (SMT)  Design 

SMT  involves  placing  a  component  directly  onto  the  surface  of  a  printed  circuit 
tx>ard  (PCB)  and  soldering  its  connections  in  place.  SMT  components  can  be 
active  (integrated  circuits)  or  passive  devices  (resistors),  and  can  have  different 
lead  designs  as  presented  below.  In  either  case,  the  solder  connection  is  both  an 
electrical  and  mechanical  connection,  thus  replacing  the  mechanical  connection 
associated  with  plated  through  holes  (PTH).  Maximizing  the  integrity  of  SMT 
designs  centers  around  minimizing  the  thermal  and  mechanical  fatigue  of  both  the 
component's  solder  connection  and  the  board's  PTHs. 

Common  Lead  Designs 


Leadless  Gull-wing  J-lead  S-lead 


Leadless  Chip  Carriers  (LCCs):  Attaching  component  to  board  directly  with  solder 
alone. 

Leaded  Chip  Carrier:  Attaching  a  leaded  component  to  board  with  solder. 

CTE:  Coefficient  of  Thermal  Expansion  is  the  change  in  length  per  unit  length 
when  heated  through  one  degree.  It  directly  effects  the  thermal  strain  and  thus  the 
stress  in  the  solder  joint. 

Design  Guideiines 

•  Use  the  largest  allowable  standard  size  for  passive  components  to  minimize 
manufacturing  flaws. 

•  Carefully  consider  the  application  for  active  devices  when  electing  to  use 
leadless  versus  leaded  components. 

•  Use  special  CTE  matching  to  preclude  stress  crackrfj  in  LCC  solder  joints. 

•  Minimize  PCB  to  13"  x  13"  size  to  avoid  warp  and  twist  problems. 

•  Provide  an  adequate  clearance  at  the  board's  edge  in  order  to  provide  space 
for  the  board  mounting  and  wave  solder  conveyor  fingers. 

•  Locate  components  on  a  grid  to  ease  programming  of  automatic  dispensing 
or  placement  equipment. 

•  Allow  proper  spacing  between  components  to  account  for  visual  inspection, 
rework,  and  engineering  changes  to  assembly. 
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Topic  D8:  Power  Supply  Design  Checklist 

For  many  years  power  supply  reliability  has  fallen  short  of  expectations  especially 
when  used  in  adverse  environments.  Today  the  situation  is  even  worse  as  power 
supplies  are  being  designed  to  exceed  three  watts  per  cubic  inch  -  a  challenge  to 
construction  and  packaging  techniques  and  part  technology.  And,  since  high 
density  means  more  concentrated  heat  -  the  enemy  of  all  components  -  power 
supply  reliability  problems  will  prevail.  Following  are  design  considerations  and 
possible  solutions  to  review; 

Table  D8-1 :  Design  Checklist  (New  Designs) 


Items  to  be  Addressed 

Soiutions/Racommendatlons 

•  Transient  affects 
-  In-rush  current 

e 

Apply  resistor-triac  technique,  thermistor 
technique 

-  High-voltage  spikes 

• 

Apply  metal  oxide  varistor  (MOV)  transient 
voltage  suppressor 

-  Short  circuits 

e 

Apply  constant  current  and  current  foldback 
protection 

-  Switching  voltage  transients 

• 

Apply  snubber  circuits 

•  Effects  of  AC  ripple  current 

• 

Consider  use  of  MIL-C-39006/22  capacitors 

•  Corrosion  due  to  leakage 

e 

Avoid  wet  slug  tantalum  capacitors  and  use 
plating  and  protective  finishes 

•  Aluminum  electrolytic  capacitors 

• 

Epoxy  end-seals  minimize  external 
contamination 

•  Temperature  stability 

e 

Use  low  temperature  coefficient  capacitors 
(mica  or  ceramic) 

•  Packaging  techniques 

o 

Enhance  heat  transfer,  control 
electromagnetic  interference,  decrease 
parasitic  capacitance 

•  Saturation 

« 

Use  antisaturation  diodes  (Baker  Clamps)  in 
conjunction  with  a  switching  transistor 

•  Potentiometers 

9 

Replace  with  precision  fixed  resistor 

•  Short  mounting  leads 

• 

Derate  the  operating  voltage  below  50%  to 
prevent  hot  spots 
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ItMiM  to  be  Addressed 

Scdutlona/Rscommendations 

•  Static  discharge  damage 

•  Use  antistatic  grounds  for  manufacturing  and 
maintenance 

•  Field  effect  transistor  (FET) 
versus  bipolar  device 

•  FETs  increase  switching  speeds  but  reduce 
drive  capability 

•  Junction  temperatures 

•  Do  not  exceed  1 10*C 

•  Mechanical  stresses 

•  Use  of  vibration  isolators/shock  mountings, 
parts  spaced  to  prevent  contact  during  shock 
&  vibration 

•  Solder  joint  process 

•  95%(goal)  of  solder  joints  should  be  made  via 

automated  process 

•  Cooling 

*  CorKfuctive  cooling  to  a  heat  exchanger  is 
preferred 

Table  D8-2:  Design  Checklist  (Commercial  Designs)  | 

Items  to  be  Addressed 

Solutlona/Recommendations  I 

•  Part  quality  •  Vendor  selects  military  equivalent  parts 

•  Vendor  selects  prescreened  parts 

•  Vendor  screens/tests  in-house 


•  Unit  quality  •  Vendor  bums-in  all  units  at  higher  temps 

•  Part  derating  •  Vendor  has  in-house  standards 

•  Electrical  parameters  •  Vendor  values  exceed  needs  at  temp 

extremes 

•  Failure  analysis  •  Vendor  has  failure  tracking  program 

•  Protection  circuits  •  Vendor  has  built-in  voltage  and  current 

sensors 

•  Fault  flags  •  Vendor  has  built-in  failure  indicators 


•  Reliability  experience  •  Successful  operation  in  similar  environments 
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Topic  D9:  Part  Failure  Modes  and  Mechanisms 

To  properlv  apply  electronic  parts  in  complex  and  high  density  equipment  designs, 
the  engineer  needs  to  know  what  factors  are  significant.  With  knowledge  about  the 
failure  modes,  mechanisms,  and  frequency  of  occurrence  design  changes  can  be 
instituted  to  eliminate  or  degrade  the  accelerating  factors  thereby  increasing  the 
equipment  reliability.  Table  D9-1  presents  these  factors  for  a  representative  group 
of  electronic  components.  For  further  information  on  part  construction  and 
operation,  consult  MIL-HDBK-978B,  "NASA  Parts  Application  Handbook,"  or  MIL- 
HOBK-338,  "Electronic  Reliability  Design  Handbook." 


Table  D9-1 :  Part  Failure  Modes  and  Mechanisms 


Type 

Failure  Mechanisms 

% 

Failure  Modes 

Accelerating  Factors 

MIcrocIrcuHs 

Digital 

Oxide  Defect 

9 

Short/Stuck  High 

Electric  Field,  Temp. 

Electromigration 

6 

Open/Stuck  Low 

Power,  Temp. 

Overstress 

18 

Short  then  Open 

Power 

Contamination 

16 

Short/Stuck  High 

Vibration,  Shock, 
Moisture,  Temp. 

Mechanical 

17 

Stuck  Low 

Shock,  Vibration 

Elec.  Parameters 

33 

Degraded 

Temp.,  Power 

Memory 

Oxide  Defect 

17 

Short/Stuck  High 

Electric  Field,  Temp. 

Overstress 

22 

Short  then  Open  or 
Stuck  Low 

Power,  Temp. 

Contamination 

25 

Short/Stuck  High 

Vibration,  Shock 
Moisture,  Temp. 

Mechanical 

9 

Stuck  Low 

Shock,  Vibration 

Elec.  Parameters 

26 

Degraded 

Temp.,  Power 

Linear 

Overstress 

21 

Short  then  Open  or 
Stuck  Low 

Power,  Temp. 

Contamination 

12 

Short/Stuck 

Vibration,  Shock 

Mechanical 

2 

Stuck  Low 

Shock,  Vibration 

Elec.  Parameters 

48 

Degraded 

Temp.,  Power 

Unknown 

16 

Stuck  High  or  a 

Hybrid 

Overstress 

17 

Short  then  Open 

Power,  Temp 

Contamination 

8 

Short 

Vibration,  Shock 

Mechanical 

13 

Open 

Shock,  Vibration 

Elec.  Parameters 

20 

Degraded 

Temp.,  Power 

Metallization 

10 

Open 

Temp.,  Power 

Substrate  Fracture 

8 

Open 

Vibration 

Miscellaneous 

23 

Open 
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DESIGN  -  TOPIC  D9 


Typ*  Fallur*  Machanisms  % 


Dfcxtoa 


Signal 

Elec.  Parameter 

48 

Die  Fracture 

10 

Seal  Leak 

3 

Overstress 

17 

Unknown 

21 

Zener 

Elec.  Parameter 

32 

Leakage  Current 

7 

Mechanical 

1 

Overstress 

33 

Unknown 

26 

Transistors 

Bipolar 

Overstress 

54 

Elec.  Parameters 

25 

Leakage  Current 

10 

Miscellaneous 

10 

Field  Effect 

Overstress 

51 

Elec.  Parameters 

17 

Contamination 

15 

Miscellaneous 

16 

Resistors 

Composition 

Moisture  Intrusion 

45 

Non-uniform  Material 

15 

Film 

Contamination 

Lead  Defects 

Moisture  Intrusion 

14 

25 

31 

Substrate  Defects 

25 

Film  Imperfections 

25 

Lead  Termination 

9 

Film  Material  Damage 

9 

Falkirs  Modes 

Accelerating  Factors 

Degraded 

Open 

Open 

Short  then  Open 
Open 

Temp.,  Power 

Vibration 

Moisture,  Temp. 

Power,  Temp. 

Degraded 

Degraded 

Open 

Short  then  Open 
Open 

Temp.,  Power 

Power 

Shock,  Vbration 
Voltage,  Temp. 

Short  then  Open 

Degraded 

Degraded 

Open 

Power,  Temp. 

Temp.,  Power 

Power 

Short  then  Open 
Degraded 

Short 

Open 

Power,  Temp. 

Temp.,  Power 
Vibration,  Shock 

Resistance  (R) 
Change 

Moisture,  Temp. 

R  Change,  Open 

Voltage/Current, 

Temp. 

R  Change 

Voltage/Current, 

Temp. 

Open 

Moisture,  Temp., 
Voltage/Current 

R  Change 

Moisture,  Temp., 
Contamination 

R  Change 

Temp.,  Voltage/ 
Current 

R  Change,  Open 

Temp.,  Voltage/ 
Current 

Open 

Shock,  Vibration, 
Temp.,  Voltage/ 
Current 

R  Change,  Open 

Temp.,  Voltage/ 
Current 
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DESIGN  -  TOPIC  D9 


Typ# 

Failure  Mechanisms 

■1 

Failure  Modes 

Accelerating  Faclore 

Resistor  (cont'd) 

Wirewound 

Wire  Imperfection 

32 

Open 

Voltage/Current, 

Temp. 

Wire  Insulation  Flaw 

20 

R  Change,  Short 

Voltage/Current, 

Temp. 

Corrosion 

31 

R  Change,  Short 

Temp.,  Moisture 

Lead  Defects 

10 

Open 

Shock,  Vibration, 
Voltage/Current 

Intrawinding 

Insulation  Breakdown 

6 

R  Change,  Short 

Temp.,  Voltage/ 
Current 

Capacitors 

Ceramic 

Dielectric  Breakdown 
Connection  Failure 

49 

Short 

Voltage,  Temp. 

Surface 

18 

Open 

Temp.,  Cycling 

Contamination 

Low  Insulation 

3 

Capacitance  Drift 

Temp.,  Voltage 

Resistance 

29 

Short 

Temp.,  Voltage 

Plastic/Paper 

Connection  Failure 

46 

Open 

Temp.,  Cycling 

Cracked  Dielectric 

11 

Short 

Temp.,  Voltage 

Capacitance  Change 

42 

Degraded 

Temp.,  Voltage 

Tantalum 

Loss  of  Electrolyte 

17 

Capacitance  Drift 

Temp.,  Voltage 

(Nonsolid) 

Leakage  Current 

46 

Short 

Voltage,  Temp. 

Intermittent  High 
Impedance 

Inductive  Devices 

36 

Open 

Temp.,  Cycling 

Transformer 

Wire  Overstress 

25 

Open 

Voltage,  Current 

Faulty  Leads 

5 

Open 

Vibration,  Shock 

Corroded  Windings 

24 

Short 

Moisture,  Temp. 

Insulation  Breakdown 
Insulation 

25 

Short 

Voltage,  Moisture, 
Temp. 

Deterioration 

20 

Short 

Moisture,  Temp. 

RFCoil 

Wire  Overstress 

37 

Open 

Voltage,  Current 

Faulty  Leads 

16 

Open 

Vibration,  Shock 

Insulation  Breakdown 

14 

Short 

Voltage,  Moisture, 
Temp. 

Insulation 

Deterioration 

32 

Short 

Moisture,  Temp. 
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DESIGN  -  TOPIC  09 


Typ« 

Failure  Mectianisms 

% 

Failure  Modes 

Accelerating  Factors 

SMritch 

Ganeral 

Contact  Resistance 

30 

Open 

Temp.,  Moisture, 
Current 

Mechanical 

23 

Open 

Vibration,  Shock 

Overstress 

18 

Short 

Power,  Temp. 

Elec.  Parameters 

13 

Degraded 

Temp.,  Power 

Intermittent 

15 

Degraded 

Temp.,  Vferation 

ftolay 

General 

Contact  Resistance 

53 

Open 

Temp.,  Moisture 

Contact 

Contamination 

18 

C^n 

Moisture,  Temp. 

Overstress 

11 

Short 

Current 

Intermittent 

12 

Degraded 

Temp.,  Vibration 

Mechanical 

5 

Open 

Vibration 

Connector 

General 

Contact  Resistance 

9 

Resistance  Change 

Temp.,  Moisture 

Intermittent 

22 

Open 

Vibration,  Shock 

Mechanical 

24 

Open 

Vibration,  Shock 

Overstress 

9 

Short 

Power,  Contamination 
Temp.,  Vibratbn, 

Miscellaneous 

35 

Open 

Wear 
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DESIGN  -  TOPIC  DIO 


Topic  D10:  Fiber  Optic  Design  Criteria 

Fiber  optics  are  relatively  new  when  compared  with  most  electronic  devices.  With 
the  increased  use  of  fiber  optics  comes  the  need  to  address  fiber  optic  reliability  so 
that  preventive  design  measures  can  be  instituted.  This  section  will  present 
specific  failure  modes/mechanisms  and  their  causes  and  prevention  to  aid 
designers/planners  in  establishing  a  reliable  system.  Tables  DlO-1  thru  D10-3 
depict  those  failure  modes/mechanisms  associated  with  Transmitters,  Receivers 
and  Fiber  &  Cable.  Table  DIO-4  presents  reliability  figures  of  merit  with  an  80% 
confidence  bound  except  connectors. 


Table  D10-1:  Common  Failure  Mechanisms  (Transmitters) 


Mode 

Causes 

Prevention 

Facet  Damage 

Pulse  width  &  optical  power 
density 

Apply  anti-reflection  coat  to  facets 

Laser  Wear-Out 

Photo-Oxidation,  contact 
degradation  &  crystal  growth 
defects 

Coat  facets,  reduce  temperature 
&  current  density  &  use  high 
quality  materials 

Laser  Instability 

Reflection  of  laser  output 
power 

Apply  antirefleclion  coat,  defocus 
the  graded  index  coupling 
element 

Shorted  Outputs 

Whisker  formation 

Anticipate  system  lifetime  & 
temperature  solder  tolerances 

Dark  Line  Defects 

Non-Radiating  centers 

Material  selection  &  quality 
control 

Table  D10-2:  Common  Failure  Mechanisms  (Receivers) 

Mode 

Causes 

Prevention 

Open  Circuit 

Fracture  of  lead-bond  plated 
contacts 

Use  evaporated  contacts 

Short  or  Open  Circuit 

Electro-Chemical  oxidation, 
humidity 

Use  hermetically  sealed  package 

Positive  Intrinsic 
Negative  (PIN)  Dark 

Accumulation  of  mobile  ions 

InGaAs  or  In  layer  grown  on 
active  region  &  reduce  the 

Current  temperature 

Avalanche  Photo  Diode  Thermal  deterioration  of  the  Select  an  APD  at  1 .3pm  &  reduce 
(APD)  Dark  Current  metal  contact  jhe  temperature 
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DESIGN -TOPIC  DIO 


Table  DIO-3: 

Common  Failure  Mechanisms  (Fiber  &  Cable)  | 

Mod* 

Caua*s 

Prevention 

Cable  Open 

Stress  corrosion  or  fatigue 

Residual  or  threshold  tension  less 

Circuit  Fracture 

due  to  microcracks 

than  33%  of  the  rated  proof  tested 
tensile  strength 

Cable  Intermittent 

Hydrogen  migrates  into  the 

Design  cables  with  materials  that 

core  of  the  fiber 

do  not  generate  hydrogen 

Cable  Open 

Temperature  cycling. 

Design  a  jacket  that  can  prevent 

Circuit  Breakage 

ultraviolet  exposure,  water  & 

shrinking,  cracking,  swelling  or 

fluid  immersion 

splitting 

Cable  Opaque  Circuit  Radiation 

Design  to  be  nuclear  radiatbn 

Inoperative 

hardened 

Table  D10-4: 

Fiber  Optic  Component  Failure  Rates 

Component  Type 

Failure  Rate  (10“^  Hre.) 

MTBF  (Hre.) 

Fiber 

4.35-5.26 

210,000 

Cable 

1.15-1.81 

750,000 

Splices 

.022  -  .64 

27,000,000 

Connectors 

#  of  Matings 

MIL-T-29504 

1000 

MIL-C-28876 

500 

N/A 

MIL-C-38999 

500 

MIL-C-83522 

500 

MIL-C-83526 

1000 

FC-Style 

1000 

Light  Emitting  Diodes  (LEDS) 

AIGaAs/GaAs 

.13 -.88 

4,000,000 

InGaAsP/lnP 

.78-1.92 

850,000 

AIGaAs/Si 

2.08  -  8.33 

320,000 

Laser  Diodes 

AIGaAs/GaAs 

1.27-9.1 

410,000 

-  1 .3pm  wavelength  .79-9.1 

620,000 

InGaAsP/lnP 

.13-2.4 

3,700,000 

Photodetectors 

APD 

.12-1.54 

4,000,000 

PIN 

.57  -  3.58 

1,000,000 
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Analysis 
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Insight 

Reliability  and  maintainability  analyses  are  a  necessary  part  of  most  development 
programs.  They  provide  a  means  of  determining  how  well  the  design  is 
progressing  towards  meeting  the  program's  goals  and  requirements.  They  also 
provide  means  of  evaluating  the  impact  of  important  design  decisions  such  as 
cooling  approaches,  classes  of  part  quality  being  used,  and  areas  of  fault  tolerance. 
In  order  for  the  government  to  receive  the  outputs  of  contractor  performed 
analyses,  appropriate  contract  deliverable  data  items  must  he  required. 


For  More  Information 


MIL-STD-756 

MIL-STD-1629 

MI-HDBK-217 

MIL-HDBK-472 

RADC-TR-87-55 

RADC-TR-77-287 

RADC-TR-89-223 

RADC-TR-89-276 

RADC-TR-89-281 

RADC-TR-90-109 

RL-TR-91-29 

RL'TR-91-87 

RL-TR-91-155 

RL-TR-92-197 


"Reliability  Modeling  and  Prediction" 

"Procedures  for  Performing  a  Failure  Mode,  Effects  and 
Criticality  Analysis" 

"Reliability  Prediction  of  Electronic  Equipment" 

"Mt  'ntainability  Prediction" 

"Predictors  of  Organizational-Level  Testability  Analysis" 

"A  Redundancy  Notebook" 

"Sneak  Circuit  Analysis  for  the  Common  Man" 

"Dormant  Missile  Test  Effectiveness" 

"Reliability  Assessment  Using  Finite  Element  Techniques" 

"Integration  of  Sneak  Analysis  with  Design" 

"A  Rome  Laboratory  Guide  to  Basic  Training  in  TQM 
Analysis  Techniques" 

"  A  Survey  of  Reliability,  Maintainability,  Supportability  and 
Testability  Software  Tools" 

"Computer  Aided  Assessment  of  Reliability  Using  Finite 
Element  Methods" 

"Reliability  Assessment  of  Critical  Electronic  Components" 
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Topic  A1-1 :  R&M  Analysis  Types,  Purpose  and  Application 


ANALYSIS  •  TOPIC  A1 


Topic  A1 :  Reliability  and  Maintainability  Analyaes 
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To  evaluate  the  simultaneous  existence  of  •  Use  selectively 
all  unfavorable  toleran  <^3 


ANALYSIS  -  TOPIC  A1 


Table  A1-2:  Summary  of  Failure  Effects  Analysis  Characteristics 


Inductive 

la 

iHi 

Deductive 

X 

Specialized  Application 

X 

X 

Time  Dependency 

X 

Advanced  Math 

X 

Sinqie  Failures 

mm 

X 

X 

X 

Multiple  Failures 

X 

External  Influences 

X 

X 

X 

Any  Desiqn  Staqe 

mm 

X 

X 

Early  Desiqn  Staqe 

n 

X 

I' 

X 

Late  Desiqn  Staae 

X 

X 

Loqistics  Application 

X 

X 

Testability  Application 

■ii 

X 

X 

ROME  LABORATORY  RELIABILITY  ENGINEER’S  TOOLKIT 


79 


ANALYSIS  -  TOPIC  A2 
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’MIL-HDBK-217F,  "Reliability  Prediction  of  Electronic  Equipment" 


ANALYSIS  -  TOPIC  A3 


A3:  Maintainability  Prediction  Methods 
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'ocedura  Purpose  Application  Basic  Paramstars  of  Information  Raquirad 


ANALYSIS  -  TOPIC  A3 
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ANALYSIS  -  TOPIC  A4 


opic  A4:  Tostability  Analysis  Msthods 
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Reference  RL-TR-92-12,  Testability  Design  Rating  System,"  (Two  Volumes) 

Testability  Program  for  Electronic  Systems  and  Equipments 

Testability  Design  and  Assessment  Tools,"  available  from  the  Reliability  Analysis  Center,  (315)  337-0900. 


ANALYSIS  -  TOPIC  A5 


Topic  A5:  Reliability  Analysis  Checklist 


Ma|or  Concerns 

Models 

Are  all  functional  elements  included  in  the 
reliability  block  diagrams/model? 

Are  all  modes  of  operation  considered  in  the 
math  model? 

Do  the  math  model  results  show  that  the 
design  achieves  the  reliability  requirement? 

Allocation 

Are  system  reliability  requirements  allocated 
(subdivided)  to  useful  levels? 


Does  the  allocation  process  consider 
complexity,  design  flexibility  and  safety 
margins? 

Prediction 

Does  the  sum  of  the  parts  equal  the  value  of 
the  module  or  unit? 


Are  the  environmental  conditions  and  part 
quality  representative  of  the  requirements? 


Are  the  circuit  and  part  temperatures 
defined  and  do  they  represent  the  design? 


Are  equipment,  assembly,  subassembly  and 
part  reliability  drivers  identified? 


Are  part  failure  rates  from  acceptable 
sources  (i.e.,  MIL-HDBK-217)? 


Is  the  level  of  detail  for  the  part  failure  rate 
models  sufficient  to  reconstruct  the  result? 


Are  critical  components  such  as  VHSIC, 
Monolithic  Microwave  Integrated  Circuits 
(MMIC),  Application  Specific  Integrated 
Circuits  (ASIC)  or  Hybrids  highlighted? 


Comments 


System  design  drawings/diagrams  must  be 
reviewed  to  ^  sure  that  the  reliability 
model/diagram  agrees  with  the  hardware. 

Duty  cycles,  alternate  paths,  degraded 
conditions  and  redundant  units  must  be 
defined  and  modeled. 

Unit  failure  rates  and  redundancy  equations 
are  used  from  the  detailed  part  predictions 
in  the  system  math  model. 

Useful  levels  are  defined  as:  equipment  for 
subcontractors,  assemblies  for 
subcontractors,  circuit  boards  for  designers. 

Conservative  values  are  needed  to  prevent 
reallocation  at  every  design  change. 


Many  predictions  conveniently  neglect  to 
include  all  the  parts  producing  optimistic 
results  (check  for  solder  connectbns, 
connectors,  circuit  boards). 

Optimistic  quality  levels  and  favorable 
environmental  conditions  are  often  assumed 
causing  optimistic  results. 

Temperature  is  the  biggest  driver  of  part 
failure  rates;  low  temperature  assumptions 
will  cause  optimistic  results. 

Identification  is  needed  so  that  corrective 
actions  for  reliability  improvement  can  be 
considered. 

Use  of  generic  failure  rates  require 
submission  of  backup  data  to  provide 
credence  in  the  values. 

Each  component  type  should  be  sampled 
and  failure  rates  completely  reconstructed 
for  accuracy. 

Prediction  methods  for  advanced  parts 
should  be  carefully  evaluated  for  impact  on 
the  module  and  system. 
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ANALYSIS  -  TOPIC  A6 


Topic  A6:  Use  of  Existing  Reiiabiiity  Data 

System  development  programs  often  make  use  of  existing  equ^ment  (or  asserTt>ly) 
designs,  or  designs  adapted  to  a  particular  application,  ^metimes,  lack  of  detailed 
design  information  prevents  direct  prediction  of  the  reiiabiiity  of  these  items  making 
use  of  avaiiable  field  and/or  test  failure  data  the  only  practical  way  to  estimate  their 
reiiabiiity.  if  this  situation  exists,  the  following  tabie  summarizes  the  information  that 
is  desired. 

Table  A6-1:  Use  of  Existing  Reliability  Data 

Equipment  Equipment  Piece  Part 

Information  Required _ Field  Data  Teat  Data  Data 

Data  collection  time  period  XXX 

Number  of  operating  hours  per  equipment  X  X 

Total  number  of  part  hours  X 

Total  number  of  observed  maintenance  X 

actions 

Number  of  ’no  defect  found*  maintenance  X 

actions 

Number  of  induced  maintenance  actions  X 

Number  of  ’hard  failure*  maintenance  X 

actions 


Number  of  observed  failures  X  X 

Number  of  relevant  failures  X  X 

Number  of  nonrelevant  failures  X  X 

Failure  definition  X  X 

Number  of  equipment  or  parts  to  which  XXX 

data  pertains 

Similarity  of  equipment  of  interest  to  XX 

equipment  for  which  data  is  available 

Environmental  stress  associated  with  data  XXX 

Type  of  testing  X 


Type  of  testing  X 

Field  data  source  X 
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ANALYSIS  -  TOPIC  A7 


Topic  A7:  Maintainability/Testability  Analysis  Checklist 


Mijor  Concern* 


Comment* 


Are  the  maintainabilityAestability  prediction 
techniques  and  data  used  clearly 
desaib^? 

Is  there  a  clear  description  of  the 
maintenance  concept  and  all  ground  rule 
assumptions? 


Are  worksheets  provided  which  show  how 
LRU  repair  times  were  arrived  at? 

Are  step-by-step  repair  descriptions 
provided  to  back  up  repair  time  estimates? 

Are  fault  isolation  time  estimates  realistic? 


Are  fault  isolation  ambiguity  levels 
considered  in  the  analysis? 

Can  repair  times  be  reconstructed  from  the 
worksheets  and  is  addition,  subtraction, 
multiplication  and  division  correct? 

Are  preventive  maintenance  tasks 
described? 

Is  all  the  equipment  included  in  the 
prediction? 

Has  the  best  procedure  bean  selected  to 
provide  estimates  for  the  testability 
attributes? 


Are  the  numerical  values  of  the  testability 
attributes  within  specified  tolerances? 

Does  the  test  equipment,  both  hardware 
and  software,  meet  all  design  requirements. 

Are  the  simulation  and  emulation  procedure 
to  be  used  to  simulate/emulate  units  of  the 
system,  for  diagnostics  development, 
reasonable  and  practical? 


Repair  level,  LRU/module  definition, 
spares  availability  assumptions,  test 
equipment  availability  assumptions,  tools 
availability  assumptions,  personnel 
assumptions,  environmental  conditions. 

The  breakout  of  repair  time  should 
include:  fault  isolation,  disassembly, 
interchange,  reassembly  and  checkout 


Overestimating  BIT/FIT  capability  is  the 
primary  cause  of  optimistic  repair  time 
estimates. 


Checking  is  mundane  but  often  results  in 
errors  and  inconsistencies  being  found. 


This  includes  frequency,  maintenance 
time  and  detailed  task  description. 


Because  of  the  number  of  variables 
which  effect  testability  and  the  number  of 
different  procedures  available  to  effect 
analyses,  there  must  be  rationale  and 
logic  provided  to  explain  why  the 
particular  approach  was  taken. 


All  test  points  should  be  accessible. 
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ANALYSIS  -  TOPIC  A8 


TonleAS:  FMECA Analysis Chtcidist 

Major  Conoarna 

Commenta 

•  Is  a  system  definttion/description  provided 
compatible  with  the  system  spectficatior)? 

•  Are  ground  rules  clearly  stated? 

•  These  include  approach,  failure 
definition,  acceptable  degradation 
limits,  level  of  analysis,  clear 
description  of  failure  causes,  etc. 

•  Are  block  diagrams  provided  showing 
functional  dependencies  at  all  equipment 
indenture  levels? 

•  This  diagram  should  graphically  show 
what  items  (parts,  circuit  cards,  sub¬ 
systems,  etc.)  are  required  tor  the 
successful  operation  of  the  next  higher 
assembly. 

•  Does  the  failure  effect  analysis  start  at  the 
lowest  hardware  level  and  systematically 
work  to  higher  indenture  levels? 

•  The  analysis  should  start  at  the  lowest 
level  specified  in  the  SOW  (e.g.  part, 
circuit  card,  subsystem,  etc.) 

•  Are  failure  mode  data  sources  fully 
described? 

•  Specifically  identify  data  sources  per 
MIL-HDBK-338,  Para  7.3.2,  include 
relevant  data  from  similar  systems. 

•  Are  detailed  FMECA  worksheets 
provided?  Do  the  worksheets  clearly 
track  from  lower  to  higher  hardware 
levels?  Do  the  worksheets  clearly 
correspond  to  the  block  diagrams?  Do 
the  worksheets  provide  an  adequate 
scope  of  analysis? 

•  Worksheets  should  provide  an  item 
name  indenture  code,  item  function,  list 
of  item  failure  modes,  effect  on  next 
higher  assembly  and  system  for  each 
failure  mode,  and  a  criticality  ranking. 

In  addition,  worksheets  should  account 
for  multiple  failure  indenture  levels  for 
Class  1  and  Class  II  failures. 

•  Are  failure  severity  classes  provided?  Are 
specific  failure  definitions  established? 

•  Typical  classes  are; 

-  Catastrophic  (life/death) 

-  Critical  (mission  loss) 

-  Marginal  (mission  degradation) 

-  Minor  (maintenance/repair) 

•  Are  results  timely? 

•  Analysis  must  be  performed  ’during" 
the  design  phase  not  after  the  fact. 

•  Are  results  clearly  summarized  and  are 
clean  comprehensive  recommendations 
provided? 

•  Actions  for  risk  reduction  of  singie  point 
failures,  critical  items,  areas  ne^ing 
BIT/FIT,  etc. 

•  Are  the  results  being  submitted  (shared) 
to  enhance  other  program  decisions? 

•  BIT  design,  critical  parts,  reliability 
prediction,  derating,  fault  tolerance. 
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ANALYSIS  -  TOPIC  A9 


Topic  A9:  Redundancy  Equations 

Many  military  electronic  systems  readiness  and  availability  requirements  exceed 
the  level  of  reliability  to  which  a  serial  chain  system  can  be  practically  designed. 
Use  of  high  quality  parts,  a  sound  thermal  design  and  extensive  stress  derating 
may  not  be  enough.  Fault  tolerance,  or  the  ability  of  a  system  design  to  tolerate  a 
failure  or  degradation  without  system  failure,  is  required.  The  most  common  form 
of  fault  tolerance  is  redundancy  where  additional,  usually  identical,  units  are  added 
to  a  system  in  parallel  with  the  other  units.  Because  this  situation  is  very  common, 
the  reliability  equations  for  common  redundancy  situations  are  included  below. 

The  following  represents  a  sample  list  of  specific  redundancy  relationships  which 
define  failure  rate  as  a  function  of  the  specific  type  of  redundancy  employ^.  For  a 
comprehensive  treatment  of  redundancy  concepts  and  the  reliability  improvements 
achievable  through  their  applications  see  RADC-TR-77-287,  “A  Redundancy 
Notebook." 
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ANALYSIS  -  TOPIC  A9 _ 

Table  A9-1 :  Redundancy  Equation  Approximations  Summary 


Radundancy  Equations 


With  Repair 

Without  Repair 

All  units  are  active  on-line  with  equal  unit 
failure  rates,  (n-q)  out  of  n  required  for 
success. 

Equation  1 

nl  (X)*’-"’ 
(n-qVn-^n.q-1)!(p)9 

Equation  4 

^n-q)/n  -  „ 

.5:  T 
i=n-q 

Two  active  on-line  units  with  different  failure 
and  repair  rates.  One  of  two  required  for 
success. 

Equation  2 

WB[(|iA+|iB)+(>A+^)] 

"  (ma)(pb)+(ma+pb)(^a+^) 

Equation  5 

Xa2Xb+XaXb2 

^''2-xa2+Xb2+XaXb 

One  standby  off-line  unit  with  n  active  on¬ 
line  units  required  for  success.  Off-line 
spare  assumed  to  have  a  failure  rate  of 
zero.  On-line  units  have  equal  failure  rates. 

Equation  3 

n[nX+(1-P)pjx 

p+n(P+1)X 

Equation  6 

nX 

*Ti/n+1  * 

Key: 

Xx/y  is  the  effective  failure  rate  of  the  redundant  configuration  where  x  of  y  units  are 
required  for  success 

n  »  number  of  active  on-line  units,  n!  is  n  factorial  (e.g.,  51=5x4x3x2x1 =120, 

11-1, 01=1) 

X  =  failure  rate  of  an  individual  on-line  unit  (failures/hour) 
q  »  number  of  on-line  active  units  which  are  allowed  to  fail  without  system  failure 
-  repair  rate  (^=1 /Met,  where  Met  is  the  rriean  corrective  maintenance  time  in 
hours) 

P  >  probability  switching  mechanism  will  operate  properly  when  needed  (P«1  with 
_ perfect  switching) _ 

Notes: 

1.  Assumes  all  units  are  functional  at  the  start 

2.  The  approximations  represent  time  to  first  failure 

3.  CAUTION:  Redundancy  equations  for  repairable  systems  should  not  be  applied  if 


delayed  maintenance  is  used. 
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ANALYSIS  -  TOPIC  A9 


Example  1 :  a  system  has  five  active  units,  each  with  a  failure  rate  of  220  f/10^ 
hours,  and  only  three  are  required  for  successful  operation.  If  one  unit  fails,  it  takes 
an  average  of  three  hours  to  repair  it  to  an  active  state.  What  is  the  effective  failure 
rate  of  this  configuration? 

Solution:  Substituting  the  following  values  into  Equation  1 : 
n  -  5 
q  =  2 
p  =  1/3 

^(5-2)/5  *  ^/5 


^/5 

^/5 


^  51(220 ,  5.75 
(5-2-1)!(1/3r 

=  .00575  f/10®  hours 


10‘®f/hour 


Example  2:  A  ground  radar  system  has  a  2  level  weather  channel  with  a  failure 
rate  of  50  f/1 0^  hours  and  a  6  level  weather  channel  with  a  failure  rate  of  180  f/IO^ 
hours.  Although  the  6  level  channel  provides  more  comprehensive  coverage,  the 
operation  of  either  channel  will  result  In  acceptable  system  operation.  What  is  the 
effective  failure  rate  of  the  two  channels  if  one  of  two  are  required  and  the  Met  is  1 
hour? 


Solution:  Substituting  the  following  values  into  Equation  2: 
Xa  =  50  •10’® 

Xg  =  180  •  10‘® 


Pa  =  =  ■'/'^ct  = 


,  (50*10'®)(180*10'®)  (1+1) +  (50 *10  ® +  180*  10-®)] 

Xi«  =  ^ - =: - ^  =  l-S  •  10  ®f/hour 

(1)(1)  +  (1  +  1)(50*10‘®+180*10'®) 


X■^|2  =  .018  f/1 0®  hours 
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ANALYSIS  -  TOPIC  A10 


Topic  A10:  Parts  Count  Reliability  Prediction 

A  Standard  technique  for  predicting  reliability  when  detailed  design  data  such  as 
part  stress  levels  is  not  yet  available  is  the  parts  count  reliability  prediction 
technique.  The  technique  has  a  "built-in*  assumption  of  average  stress  levels 
which  allows  prediction  in  the  conceptual  stage  or  source  selection  stage  by 
estimation  of  the  part  types  and  quantities.  This  section  contains  a  summary  of  the 
MIL-HDBK-217F,  Notice  1  technique  for  eleven  of  the  nrx>st  common  operational 
environments; 

Gq  Ground  Benign 

Gp  Ground  Fixed 

G|^  Ground  Mobile 

N5  Naval  Sheltered 

N(j  Naval  Unsheltered 

A|q  Airborne  Inhabited  Cargo 

A|p  Airborne  Inhabited  Fighter 

Ajjq  Airborne  Uninhabited  Cargo 

Ajp  Airborne  Uninhabited  Fighter 

Arw  Helicopter  (Both  Internal  and  External  Equipment) 

Sp  Space  Flight 

Assuming  a  series  reliability  model,  the  equipment  failure  rate  can  be  expressed  as: 

£  (Nj)(X.gi)(nQj) 

total  equipment  failure  rate  (failures/10®  hrs) 

generic  failure  rate  for  the  ith  generic  part  type  (failures/10®  hrs) 
quality  factor  for  the  ith  generic  part  type 
quantity  of  the  ith  generic  part  type 
number  of  different  generic  part  types 


'“EQUIP 


where 


EQUIP 

^i 

^Q{ 

N: 
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Table  A10-1 :  Generic  Failure  Rate,  Xq  (Failures/10^  Hours)  for  Microcircuits 


ANALYSIS  -  TOPIC  A10 
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ANALYSIS  -TOPIC  A10 


Mlctx)clrcuM  Quality  Factors  •  rq 


Description 


Class  S  Categories: 

1 .  Procured  in  full  accordance  with  MIL-M-3851 0,  Class  S  requirements. 

2.  Procured  in  full  accordance  with  MIL-l-38535  and  Appendix  B  thereto 
(Class  V). 

3.  Hybrids:  (Procured  to  Class  S  requirements  (Quality  Level  K)  of  MIL-H- 
38534. 


.25 


Class  B  Categories: 

1 .  Procured  in  full  accordance  with  MIL-M-3851 0,  Class  B  requirements. 

2.  Procured  in  full  accordance  with  MIL-l-38535,  (Class  Q). 

3.  Hybrids:  Procured  to  Class  B  requirements  (Quality  Level  H)  of  MIL-H- 
38534. 


1.0 


Class  B-1  Category: 

Fully  compliant  with  all  requirements  of  paragraph  1.2.1  of  MIL-STD-883 
and  procured  to  a  MIL  drawing,  DESC  drawing  or  other  government 
approved  documentation.  (Does  not  include  hybrids).  For  hybrids  use 
custom  screening  section  on  the  following  page. 


2.0 


Microcircuit  Learning  Factor  - 


Years  in  Production,  Y 

"L 

<.1 

2.0 

.5 

1.8 

1.0 

1.5 

1.5 

1.2 

>2.0 

1.0 

til  =  01  exp(5.35  -  .35Y) 

Y  -  Years  generic  device  type  has  been  in  production 
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Microcireult  QualKy  Factors  (cont'd):  icq  Calculation  for  Custom  Scraaning  Programs 


Group 


MIL-STIV883  ScraenTTaat  (Mots  3) 


TM  1010  (Temperature  Cycle,  Cond  B  Minimum)  and  TM 
2001  (Constant  Acceleration,  Cond  B  Minimum)  and  TM 
5004  (or  5008  for  Hybrids)  (Rnal  Electricals  @  Temp 
Extremes)  and  TM  1014  (Seal  Test,  Cond  A,  B,  or  C)  and  TM 
2009  (External  Visual) 


TM  1010  (Temperature  Cycle,  Cond  B  Minimum)  or  TM  2001 
(Constant  Acceleration,  Cond  B  Minimum) 

TM  5004  (or  5008  for  Hybrids)  (Final  Electricals  @  Temp 
Extremes)  and  TM  1014  (Seal  Test,  Cond  A,  B,  or  C)  and  TM 
2009  (External  Visual) 


Pre-Burn  in  Electricals 

TM  1015  (Bum-in  B-Level/S-Level)  and  TM  5004  (or  5008  for 
Hybrids)  (Post  Burn-in  Electricals  @  Temp  Extremes) 


TM  2020  Pind  (Particle  Impact  Noise  Detection) 

TM  5004  (or  5008  for  Hybrids)  (Final  Electricals  @ 
Temperature  Extremes) 

TM  2010/17  (Internal  Visual) 

TM  1014  (Seal  Test,  Cond  A,  B,  or  C) 

TM  2012  (Radiography) 

TM  2009  (External  Visual) 

TM  5007/5013  (GaAs)  (Wafer  Acceptance) 

TM  2023  (Non-Destructive  Bond  Pull) 


Point 

Valuation 


11  (Note  1) 


7  (Note  2) 


7  (Note  2) 


I  Point  Valuations 

‘NOT  APPROPRIATE  FOR  PLASTIC  PARTS 
NOTES: 

1 .  Point  valuation  only  assigned  if  used  independent  of  Groups  1 ,  2  or  3. 

2.  Point  valuation  on^  assigned  if  used  inde^dent  of  Groups  1  or  2. 

3.  Sequencing  of  tests  within  grotms  1 ,  2  and  3  must  be  followed. 

4.  TM  refers  to  the  MIL-STD-883  Test  Method. 

5.  Nonhermetic  parts  should  be  used  only  in  controlled  environments  (i.e.,  Gb  and  other 
temperature/humidity  controlled  environments 


EXAMPLES: 

87 

1 .  Mfg.  performs  Group  1  test  and  Class  B  bum-in:  Xq  =  2  +  =3.1 

87 

2.  Mfg.  performs  internal  visual  test,  seal  test  tmd  final  electrical  test:  Xq  =  2  +  ^  =  5.5 


Other  Commercial  or  Unknown  Screening  Levels 
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Table  A10-2:  Generic  Failure  Rate  •  (Failures/IO^  Hours)  for  Discrete  Semiconductors 
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SiFET(f>400MHz) 

GaAsFET(P<100mW) 
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Table  A10-3:  Generic  Failure  Rate  -  Xq  (Failures/1 0^  Hours)  for  Resistors 
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Table  A10-4:  Generic  Failure  Rate  -  Xq  (Failures/10^  Hours)  for  Capacitors 
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Solid  State 

Hybrid  and  Solid  State  Time  Delay 
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Table  A10-6:  Generic  Failure  Rate  -  Xg  (Failures/1 0^  Hours)  for  Miscellaneous  Parts 


ANALYSIS  •  TOPIC  A10 


Table  A10-7:  icq  Factor  for  Use  with  Inductive, 
Electromechanical  and  Miscellaneous  Parts 


Part  Type 

Established 

Reliability 

MIL-SPEC 

Non-MIL 

Inductive  Devices 

.25 

1.0 

10 

Rotating  Devices 

N/A 

N/A 

N/A 

Relays,  Mechanical 

.60 

3.0 

9.0 

Relays.  Solid  State  and  Time 
Delay  (Hybrid  &  Solid  State) 

N/A 

1.0 

4 

Switches,  Toggle,  Pushbutton, 
Sensitive 

N/A 

1.0 

20 

Switches,  Rotary  Wafer 

N/A 

1.0 

50 

Switches,  Thumbwheel 

N/A 

1.0 

10 

Circuit  Breakers,  Thermal 

N/A 

1.0 

8.4 

Connectors 

N/A 

1.0 

2.0 

Interconnection  Assemblies 

N/A 

1.0 

2.0 

Connections 

N/A 

N/A 

N/A 

Meters,  Panel 

N/A 

1.0 

3.4 

Quartz  Crystals 

N/A 

1.0 

2.1 

Lamps,  Incandescent 

N/A 

N/A 

N/A 

Electronic  Filters 

N/A 

1.0 

2.9 

Fuses 

N/A 

N/A 

N/A 
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Topic  A1 1 :  Reliability  Adjustment  Factors 


"What  if"  questions  are  often  asked  regarding  reliability  figures  of  merit.  For  a  rapid 
translation,  tables  for  different  quality  levels,  various  environments  and 
temperatures  are  presented  to  make  estimates  of  the  effects  of  the  various 
changes.  The  data  base  for  these  tables  is  a  grouping  of  approximately  18000 
parts  from  a  number  of  equipment  reliability  predictions  performed  in-house  on 
military  contracts.  The  ratios  were  devetoped  using  this  data  base  and  MIL-HDBK- 
21 7F  algorithms.  The  relative  percentages  of  the  part  data  base  are  shown  as 
follows; 


Q  Transistors 
□  Capacitors 
1]  Resistors 
I  Integrated  Circuits 
0  Inductors 
5  Diodes 
D  Miscellaneous 


Table  A11-1 :  Part  Quality  Factors  (Multiply  MTBF  by) 

To  Quality  Class 


Space  Full  Military  Ruggedized  Commercial 


Space 

X 

0.8 

0.5 

0.2 

From 

Full  Military 

1.3 

X 

0.6 

0.2 

Quality 

Ruggedized 

2.1 

1.6 

X 

0.4 

Class 

Commercial 

5.3 

4.1 

2.5 

X 

1C 

Class  S 

Class  B 

Class  B-1 

Class  D 

Semiconductor 

JANTXV 

JANTX 

JAN 

NONMIL 

Passive  Part 

_ ER(S)  _ 

■Earn 

ER(M) 

CAUTION:  Do  not  apply  to  Mean-Time-Between-Critical-Failure  (MTBCF). 
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To  Environment 


ANALYSIS  -  TOPIC  A11 


Table  A11-2:  Environmental  Conversion  Factors 
(Multiply  MTBF  by) 


U.  Ul 


I 

9 

9 
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CAUTION:  Do  not  apply  to  MTBCF. 


ANALYSIS  -  TOPIC  A11 


Table  All *3:  Temperature  Conversion  Factors 
(Multiply  MTBF  by) 


§1  !:l  ‘nI  21  ‘31  5l  ‘?l  xl 
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Topic  A12:  Surface  Mount  Technology  (SMT) 
Assessment  Model 

The  SMT  Model  was  developed  to  assess  the  life  integrity  of  leadless  and  leaded 
devices.  It  provides  a  relative  measure  of  circuit  card  wearout  due  to  thermal 
cycling  fatigue  failure  of  the  ’weakest  link”  SMT  device.  An  analysis  should  be 
performed  on  all  circuit  board  SMT  components.  The  component  with  the  largest 
failure  rate  value  (weakest  link)  is  assessed  as  the  overall  board  failure  rate  due  to 
SMT.  The  model  assumes  the  board  is  completely  renewed  upon  failure  of  the 
weakest  link  and  the  results  do  not  consider  solder  or  lead  manufacturing  defects. 
This  model  is  based  on  the  techniques  developed  in  the  Rome  Laboratory  technical 
report  RL-TR-92-197,  "Reliability  Assessment  of  Critical  Electronic  Components." 

^SMT  =  Average  failure  rate  over  the  expected  equipment  life  cycle  due  to 
surface  mount  device  wearout.  This  failure  rate  contribution  to  the 
system  is  for  the  Surface  Mount  Device  on  each  board  exhibiting 
the  highest  absolute  value  of  the  strain  range: 

[(  Os  AT  -  acc  (AT  +  Trise))  x  10  ®] 

.  ECF 

^ 

ECF  «=  Effective  cumulative  number  of  failures  over  the  Weibull 
characteristic  life. 

Table  A12-1 :  Effective  Cumulative  Failures  -  ECF 


LC 

OSMT 

ECF 

0-.1 

.13 

.11  -  .20 

.15 

.21  -  .30 

.23 

.31  -  .40 

.31 

.41  -  .50 

.41 

.51  -  .60 

.51 

.61  -  .70 

.61 

.71  -  .80 

.68 

.81  -  .90 

.76 

>  .9 

1.0 

LC  =  Design  life  cycle  of  the  equipment  in  which  the  circuit  board  is 
operating. 
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_ ANALYSIS  -  TOPIC  A12 

aSMT  =  The  Weibull  characteristic  life.  asMT  is  a  function  of  device  and 
substrate  material,  the  manufacturing  methods,  and  the  application 
environment  used. 

Nf 

aSMT  =  ^ 

where; 

CR  =  Temperature  cycling  rate  in  cycles  per  calendar  hour 

Nf  =  Average  number  of  thermal  cycles  to  failure 

Nf  =  3.5  I  (as  AT  -  acc  (AT  +  Trise))  |x  10  ®  ^  (jtLc) 

where: 

d  =  Distance  from  center  of  device  to  the  furthest  solder  joint  in 
mils  (thousands  of  an  inch) 

h  =  Solder  joint  height  in  mils  for  leadless  devices.  Use  h  =  8 
for  all  leaded  configurations. 

as  =  Circuit  board  substrate  thermal  coefficient  of  expansion 
(TCE) 

At  =  Use  environment  temperature  difference 

occ  =  Package  material  thermal  coefficient  of  expansion  (TCE) 

Trise  =  Temperature  rise  due  to  power  dissipation  (Pd) 

Pd  =  0jcP  0JC  =  Thermal  resistance  °/Watt 

P  =  Watts 

TtLC  =  Lead  configuration  factor 

Table  A12-2:  CR  -  Cycling  Rate  Values 


Equipment  Type 

Number  of  Cycles/Hour 

Consumer  (television,  radio,  recorder) 

.0042 

Computer 

.17 

Telecommunications 

.0042 

Commerical  Aircraft 

.34 

Industrial 

.021 

Military  Ground  Applications 

.03 

Military  Aircraft 

.12 
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Table  A12-3:  ]C|_q  •  Lead  Configuration  Factor 


Lead  Configuration 

«LC 

Leadless 

1 

J  or  S  Lead 

150 

Gull  Wing 

5,000 

Table  A12-4:  acc  -  TCE  Package  Values 


Substrate  Material 

occ  Average  Value 

Plastic 

7 

Ceramic 

6 

Table  A12>5:  AT  -  Use  Environment  Temperature  Difference 


Environment 

AT 

®B 

7 

Gp 

21 

Gm 

26 

o 

< 

31 

> 

c 

o 

57 

'^ip 

31 

^UP 

57 

^RW 

31 

Nu 

61 

to 

z 

26 
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Table  A1 2-6:  03  -  TCE  Substrate  Values 


Substrate  Material 

“S 

FR-4  Laminate 

18 

FR-4  Multilayer  Board 

20 

FR-4  Multilayer  Board  w/Copper  Clad  Invar 

11 

Ceramic  Multilayer  Board 

7 

Copper  Clad  Invar 

5 

Copper  Clad  Molybdenum 

5 

Carbon-Fiber/Epoxy  Composite 

1 

Kevlar  Fiber 

3 

Quartz  Fiber 

1 

Glass  Fiber 

5 

Epoxy/Glass  Laminate 

15 

Polimide/Glass  Laminate 

13 

Polyimide/Kevlar  Laminate 

6 

Polyimide/Quartz  Laminate 

8 

Epoxy/Kevlar  Laminate 

7 

Aluminum  (Ceramic) 

7 

Epoxy  Aramkf  Fiber 

7 

PolyimkJe  Aramkf  Fiber 

6 

Epoxy-Quartz 

9 

Fiberglass  Tefbn  Laminates 

20 

Porcelainized  Copper  Clad  Invar 

7 

Fiberglass  Ceramic  Fiber 

7 

Example:  a  large  plastic  encapsulated  leadless  chip  carrier  is  mounted  on  a 
epoxy-glass  printed  wiring  assembly.  The  design  considerations  are;  a  square 
package  is  1480  mils  on  a  side,  solder  height  is  5  mils,  power  dissipation  is  .5 
watts,  thermal  resistance  is  20°C/watt,  the  design  life  is  20  years  and  environment 
is  military  grourxf  application.  The  failure  rate  developed  is  the  impact  of  SMT  for  a 
single  circuit  board  and  accounts  for  all  SMT  devices  on  this  board.  This  failure 
rate  is  added  to  the  sum  of  all  of  the  component  failure  rates  on  the  circuit  board. 


>.SMT 


ECF 

OSMT 
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aSMT  - 
Nf  - 


nl 

CR 


3.5  («S  AT  -  otcc  (AT  +  Trise))  X  10  ®^ 


-2.26 


Ford: 

d  =^(1480)  *740  mils 

Forh: 

h  *  5  mils 

Forets: 

os  - 15  (Table  A12-6  -  Epoxy  Glass) 

For  Aj: 

At  =  21  (Table  A12-5  -  Gp) 

For  otec- 

otcc  =  7  (Table  A12-4  -  Plastic) 

For  Trise: 

Trise  =  0JcP  =  2O(.5)  =  io»c 

For  KLc: 

KLC  =  1  (Table  A12-3  -  Leadless) 

ForCR: 

CR  *  .03  cycles/hour  (Table  A12-2  - 1 

Nf 

Nf 


740 


"  3.5  I  (15(21) -7(21+10)) 

=  1 8,893  thermal  cycles  to  failure 


xio-®y^'^®  (1) 


otSMT  = 


LC 


-  628.767  hours 

.03  cyles/hour 


(20yrs 


aSMT 

ECF 

^SMT 


628,767  hrs. 


.28 


.23  failures  (Table  A12-1) 
ECF  .23  failures 


osMT  628,767  hours 


s  .0000004  fallures/hour 


^MT  =  .4  failures/10®  hours 


(«LC) 
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Topic  A13:  Finito  Etomont  Analysis 

Background 

Finite  Element  Analysis  (FEA)  is  a  computer  simulation  technique  that  can  predict 
the  material  response  or  behavior  of  a  modeled  device.  These  analyses  can 
provide  material  stresses  and  temperatures  throughout  modeled  devices  by 
simulating  thermal  or  dynamic  loading  situations.  FEA  can  be  used  to  assess 
mechanical  failure  mechanisms  such  as  fatigue,  mpture,  creep,  and  buckling. 

When  to  Apply 

FEA  of  electronic  devices  can  be  time  consuming  and  analysis  candidates  must  be 
carefuily  selected.  Selection  criteria  includes  devices,  components,  or  design 
concepts  which;  (a)  Are  unproven  and  for  which  little  or  no  prior  experience  or  test 
information  is  avaiiabie;  (b)  Utiiize  advanced  or  unique  packaging  or  design 
concepts;  (c)  Will  encounter  severe  environmental  loads;  (d)  Have  critical  thermal 
or  mechanical  performance  and  behavior  constraints. 

Typical  Application 

A  typical  finite  eiement  reiiabilKy  anaiysis  of  an  electronic  device  would  be  an 
assessment  of  the  life  (i.e.  number  of  thermal  or  vibration  cycies  to  failure  or  hours 
of  operation  in  a  given  environment)  or  perhaps  the  probability  of  a  fatigue  failure 
after  a  required  time  of  operation  of  a  critical  region  or  location  within  the  device. 
Exampies  are  surface  mount  attachments  of  a  chip  carrier  to  a  circuit  board,  a 
critical  location  in  a  multichip  module,  or  a  source  via  in  a  transistor  microcircuit. 
First,  the  entire  device  (or  a  symmetrical  part  of  the  entire  device)  is  modeied  with  a 
coarse  mesh  of  relatively  large  sized  eiements  such  as  3-dimensional  brick  ele¬ 
ments.  For  example,  as  shown  in  Figure  A13-1,  an  entire  circuit  board  is  analyzed 
(Step  1).  The  loading,  materiai  property,  heat  sink  temperature,  and  structural 
support  data  are  entered  into  the  data  file  in  the  proper  format  and  sequence  as 
required  by  the  FEA  solver.  Output  deflections  and  material  stresses  for  all  node 
point  locations  on  the  model  are  then  acc^ired.  For  microelectronic  devices, 
second  or  third  follow-on  models  of  refined  regions  of  interest  may  be  required 
because  of  the  geometrically  small  feature  sizes  involved.  The  boundary  nodes  for 
the  follow-on  model  are  given  initial  temperatures  and  displacements  that  were 
acquired  from  the  circuit  board  model.  The  figure  shows  a  refined  region  containing 
a  single  chip  carrier  and  its  leads  (Step  2).  The  more  refined  models  provide 
accurate  temperature,  deflection,  and  stress  information  for  reliability  analyses.  For 
example,  the  results  of  Step  2  could  be  a  maximum  stress  value  in  a  comer  lead  of 
a  chip  carrier  caused  by  temperature  or  vibration  cycling.  A  deterministic  life 
analysis  is  made  by  iocating  the  stress  value  on  a  graph  of  stress  versus  cycles  to 
failure  for  the  appropriate  material  and  reading  cycles  to  failures  on  the  abscissa 
(Step  3).  Cycles  to  failure  and  time  to  failure  are  related  by  the  temperature  cycling 
rate  or  the  natural  frequency  for  thermal  or  dynamic  environments,  respectively.  A 
distribution  of  stress  coupled  with  a  distribution  of  strength  (i.e.  scatter  in  fatigue 
data)  wiil  result  in  a  probability  distnlsution  function  and  a  cumulative  distribution 
function  of  time  to  failure  (Step  4). 
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Step  1 


Step  2 


Step  3 


Step  4 


•  FEM  Results 

Displacement  Due 
to  Vibration  Loads 


to  Thermal  Loads 

•  Interpretation  of  Local  Displacements/Stresses 


Vibration  and  Thermal  Displacements 
Component  Relative  to  Board 


Life  Analysis 


Cycles  to  Failure 

•  Probabilistic  Reliability  Analysis 


Figure  A1 3-1 
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Topic  A14:  Common  Thermal  Analysis  Procedures 

The  following  graphs  and  associated  examples  provide  a  guide  for  performing  basic 
integrated  circuit  junction  temperature  calculations  for  three  of  the  most  common 
types  of  cooling  designs:  impingement,  cold  wall,  and  flow  through  rrudules.  This 
procedure  is  intended  to  provide  the  Reliability  Engineer  with  a  simple  means  of 
calculating  approximate  junction  temperatures  and  for  performing  a  quick  check  of 
more  detailed  thermal  analysis  calculations. 

Card-Mounted,  Flow-through  Modules 


Notes: 

1 .  Module  dissipation  uniformly  distributed  and  applied  on  bodi  sides. 

2.  The  part  Junction  temperature  is  obtained  as  follows: 


where 


Tj  -  +  ATb^  - 


*  ®CB'  ''P 


Tj  is  the  junction  temperature 
is  the  cooling  air  iniet 

aTqa  is  the  weighted  average  heat-exchanger-to-cooling-air  inlet  temperature  dilferen<»  (See  Note  4) 

Bjq  is  the  junclion-ttxase  Ihermai  resistance  in  °C/W 

0^,0  is  the  thermai  resistance  between  the  case  and  Ihe  heat  exchanger  in  °C/W 

Op  is  the  part  power  dissipation  in  watts 


3.  Aii  temperatures  are  in  °C 

4.  Weighted  average  temperature  differerKe  is  the  vaiue  at  a  location  two  thirds  of  the  distance  from  the  inlet  to 
the  outlet,  as  shown  in  stretch.  ExperierKe  has  shown  that  the  temperature  at  this  location  approximates  the 
average  board  temperature. 


Figure  A14-1 :  Estimated  Temperature  of  Card-mounted  Parts 
Using  Forced-air-cooled  Flow-through  Modules 
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Card-Mounted,  Air-Cooled  Coldwalls 


THERMAL  PLANE  THICKNESS  - 
1.27  I  10‘^m  (O.OOS  ln> 

2.54  X  10'^m  (0.010  In) 

5.08  X  lO'^m  (0.020  in) 

7.62  X  10'^m  (0.030  In) 

1.0.2  X  10'^m  (0.040  In) 

12.7  X  10'^m  (0.050  In) 

19.04  X  10"'*m  (0.075  In) 
25.4  X  10'*m  (0.1  in) 


COLO  VVALL 
INTERFACE 


.COLDWALL  . 


CIRCUIT 

BOARD 


w 

i 


Notes: 

1.  from  curve  is  for  L/W  »  2;  for  other  UW  ratios,  multiply  from  curve  by  0.5  L/W 

2.  The  junction  temperature  is  obtained  as  follows: 

,  0.03  Or 

+  ATce  ♦  Qt  {0.0761/W  +  0.25)  ♦  Op  (Sjc  +  0CB) 

where 

Tj  is  the  junction  temperature 
is  the  air  inlet  temperature 
Qt  is  the  total  card  power  dissipation  in  watts 
Op  is  the  part  power  dissipation  in  watts 
ma  is  the  airflow  rate  in  Kg/Min 

aTce  is  ths  temperature  difference  between  center  of  card  and  card  edge 

W  is  the  card  width  in  meters 

OjC  is  Ihe  junctiorvto-case  uiermal  resistance  in  °C/W 

eCB  is  the  case-to-mounting  surface  thermal  resistance  in  °C/W 

3.  All  temperatures  are  in  °C 

4.  The  card  edge  to  card  guide  interface  thermal  resistance  is  0.0761  °C/W  per  meter  of  card  width 

5.  The  ookforall  convective  thermal  resistance  is  0.25°C/W 


Figure  A14-2:  Estimated  Temperature  of  Card-mounted  Parts 
Using  Forced-air  Cooled  Coldwalls 
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Air  Impingement,  Card-Mounted 


Notes: 

1 .  The  pai^unction  temperature  is  obtained  as  follows: 

Tj  -  Ta  +  aTba  +  (ex  +  ecB)  Qp 

where 

Tj  is  the  junction  temperature 

is  the  local  cooling  air  temperature 
ATba  is  the  local  card-t»«ir  temperature  difference 
ejc  is  the  junction-to-case  thermal  resistarxre  in  °C/W 
ScB  is  the  case-to-mounting-surfaoe  thermal  resistance  in  °C/W 
Qp  is  the  part  power  dissipation  in  watts 

2.  All  temperatures  are  in  °C 

3.  Assumes  an  the  heat  is  uniformly  distributed  over  both  sides  of  the  board 

4.  Assumes  no  air  temperature  rise  (add  any  rise  in  air  temperature  to  the  result) 

Figure  A14-3:  Estimated  Temperature  of  Card-mounted  Parts 
Using  Forced-air  Impingement  Cooling  at  Sea  Level 
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Example  1:  Card  Mounted,  Air  Cooled  Coldwalls 

Estimate  the  junction  temperature  of  a  0.25-W  microcircuit  mounted  at  the  center  of 
a  coldwall-cooled  circuit  board.  0.152  X  0.102  m,  with  a  total  power  dissipation  of 
20  W.  The  part,  which  has  a  mounting  base  of  0.00635  X  0.00953  m,  is  attached  to 
the  board  with  a  7.6  X  10'^  m  (3  mils)  thick  bonding  compound  whose  thermal 
conductivity  (k)  is  0.25  W/rrv-°C.  The  forced  airflow  rate  is  1 .8  kg/min  with  an  inlet 
temperature  of  45 °C.  The  board  contains  a  5.08  X  10'^  (0.020  inch)  thick  copper 
thermal  plane.  The  0jc  of  the  part  is  50“C/W. 

1 .  From  Figure  A14-2.  ATcE  "  57*C  for  UW  »  2 

.  0.152  m  .  .. 

^“®'LW-5^f^-1.49.so 

Corrected  ATce  -  (0.5)  (1.49)  (57*C)  -  42.5“C 

2  Q  _ 7.6  X  10'^m _  g  03“C/W 

(0.25  W/m“C)  (0.00635m)  (0.00953  m)“®‘ 

3.  From  Note  2  in  Figure  A14-2 

+  ATcE  +  Or (0.0761  W  +  0.25)  +  Qp  (0JC  +  0CB) 


._  0.03  (20)  ..  _  __  /0.0761 
-  ^2.5  +  20^0^+. 

Tj  -  122*C 


+  0.25  (50  +  5.03) 


Example  2:  Air  Impingement,  Card  Mounted  Cooling 

Estimate  the  junction  temperature  of  a  part  dissipating  0.25  W  and  nfK>unted  on  a 
circuit  board  cooled  by  impingement  with  ambient  air  at  40°C  and  a  velocity  of  15 
m/s.  The  circuit  board,  whose  dimensions  are  0.102  X  0.152  m,  has  a  total  power 
dissipation  of  20  W.  The  part,  whose  mounting  base  is  0.00635  X  0.00953  m,  is 
attached  to  the  board  with  a  7.61  X  10'^  m  (3  mils)  thick  bonding  compound  whose 
thermal  conductivity  (k)  is  0.25  W/m-°C.  The  junction-to-case  thermal  resistance 
(0jc)  of  the  part  is  50‘’C/W. 

1 .  Compute  the  card  heat  flux  density  (see  Note  3  in  Figure  A14-3): 

- 2^  ^ - X  645  W/m^ 

2  (0.102  m)  (0.152  m) 

2.  From  Figure  A14-3:  ATg^  -  17’C 


3.  0CB 


_ 7.61  X  IP'S  m _ 

(0.25W/m‘’C)  (0.00635  m)  (0.00953  m) 


5.03  C/W 


4.  From  Note  1  in  Figure  A14-3 

Tj  -  Ta  +  ATba  +  (0JC  +  OCB)  Qp  -  40  +  1 7  +  (50  +  5.03)  0.25 
Tj  =  71 °C 
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Topic  A15:  Sneak  Circuit  Analysis 

Electronics  that  operate  within  their  specifications  are  still  vulnerable  to  critical 
failures.  Hidden  within  the  complexity  of  electronic  designs  are  conditions  that  sip 
past  standard  stress  tests.  These  conditions  are  known  as  sneak  circuits. 

Definitions 

•  Sneak  Circuit:  A  condition  which  causes  the  occurrence  of  an  unwanted 
function  or  inhibits  a  desired  function  even  though  all  components  function 
property. 

•  Sneak  Paths:  Unintended  electrical  paths  within  a  circuit  and  its  external 
interfaces. 

•  Sneak  Timing:  Unexpected  interruption  or  enabling  of  a  signal  due  to  switch 
circuit  timing  problems. 

•  Sneak  Indications:  Undesired  activation  or  de-activation  of  an  indicator. 

•  Sneak  Labels:  Incorrect  or  ambiguous  labeling  of  a  switch. 

•  Sneak  Clue:  Design  rule  applied  to  a  circuit  pattern  to  identify  design 
inconsistencies. 

Cause  of  Sneaks 

•  Complex  designs  with  many  interfaces 

•  Flaws  unknowingly  designed  into  equipment 

•  Switching  and  timing  requirements 

•  Incomplete  analyses  and  test 

Why  Do  Sneak  Analysis? 

•  Method  for  detecting  hidden  failures 

•  Verification  of  interface  switching  and  timing  requirements 

•  Improves  systenrYunit  reliability 

Where  are  Sneak  Circuits? 

•  Electrical  power  systems 

•  Switching  circuits 

•  Distribution  and  control  systems 

•  Software  control  functions 

•  Interface  configurations 
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Tabie  A15-1 :  Typicai  Ciue  Statements 

Clue 

Sneak 

Impact 

Fanout  Exceeded 

Design  Concern 

Unpredictable  Outputs 

Unterminated  CMOS 
Input 

Design  Concern 

Device  Damage 

Large  Time  Constant 

Sneak  Timing 

Unpredictable 

Switching  Times 

Uncommitted  Open 
Collector  Output 

Design  Concern 

False  Unstable  Logic 

Performing  Sneak  Analysis 

•  Time  to  complete  analysis:  An  average  Sneak  Circuit  Analysis  (SCA)  is  a 
lengthy  process  that  requires  several  months  to  complete.  Redrawing  the 
electronics  of  a  system  into  hundreds  of  topc^raphical  patterns  and  checking 
each  one  against  a  multitude  of  sneak  clues  is  a  time  consuming  task. 

•  Cost  of  analysis:  SCA  specialists  will  be  required  due  to  the  need  for 
proprietary  sneak  clues.  Their  cost  of  analysis  is  based  on  part  count  and 
design  complexity.  Outside  specialists,  not  familiar  with  the  design,  will 
require  extra  time  and  money  to  complete  a  detailed  analysis  of  the  functions 
and  operation  of  a  design.  This  teaming  curve  cost  is  in  addition  to  the  cost 
of  analysis. 

•  Availability  of  results:  A  manual  SCA  requires  preproduction  level 
drawings  to  prevent  late  design  changes  from  inserting  new  sneaks  into  the 
system  after  performing  the  analysis.  Extra  time  must  be  available  to  review 
the  results  or  taking  the  necessary  corrective  action  will  require  hardware 
rework,  recall,  or  redesign  rather  than  drawing  changes. 

For  More  information 

To  perform  a  manual  analysis,  many  independent  contractors  are  available  for 
contracts.  If  in-house  work  is  contemplated,  RADC-TR-89-223,  *Sneak  Circuit 
Analysis  for  the  Common  Man,”  is  recommended  as  a  guide.  Automated  tools  are 
available  including  the  Rome  Laboratory  prototype  called  SCAT  (Sneak  Circuit 
Analysis  Tool).  A  new  Rome  Laboratory  tool.  Sneak  Circuit  Analysis  Rome 
Laboratory  Engineering  Tool  (SCARLET),  is  in  development  for  future  use. 


120 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


ANALYSIS  -  TOPIC  A1 5 


Example:  Subsystem  Sneak  Circuit  Reverse  Current  Operation 

Figure  Al5-1a  shows  the  original  circuit  which  was  designed  to  prevent  routine 
opening  of  the  cargo  door  unless  the  aircraft  was  on  the  ground  with  the  gear  down 
and  locked.  The  secondary  switch  permits  emergency  operation  of  the  door  when 
the  gear  is  not  down.  Figure  Al5-1b  shows  the  network  tree  diagram  which 
indicates  the  existence  of  a  sneak  path.  If  the  emergency  and  normal  door  open 
switches  are  both  closed,  the  gear  will  be  inadvertently  towered.  The  solution  to 
the  problem  is  the  addition  of  a  diode  to  prevent  reverse  current  flow  as  shown  in 
Figure  A15-1C. 


(Mt 


rb)  NETWORK  tree 


»  Ml  I'M  N<-.» 


rc  HFVir>ED  CiRClJiT 


Figure  A15-1 :  Sneak  Circuit  Example 
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Topic  A16:  Dormant  Analysis 

In  the  past,  analysis  techniques  for  determining  reliability  estimates  for  dormant  or 
storage  conditions  relied  on  rules  of  thumb  such  as  Ihe  failure  rate  will  be  reduced 
by  a  ten  to  one  factor’  or  'the  failure  rate  expected  is  zero.*  A  more  realistic 
estimate,  based  on  part  count  failure  results,  can  be  calculated  by  applying  the 
conversion  factors  shown  in  Table  A16-1.  The  factors  convert  active  failure  rates 
by  part  type  to  passive  or  dormant  conditions  for  seven  scenarios.  For  example,  to 
convert  the  reliability  of  an  active  airborne  receiver  to  a  captive  carry  dormant 
condition,  determine  the  number  of  components  by  type,  then  multiply  each  by  the 
respective  active  failure  rate  obtained  from  handbook  data,  field  data,  or  vendor 
estimates.  The  total  active  failure  rate  for  each  type  is  converted  using  the 
conversion  factors  of  Table  At  6-1.  The  dormant  estimate  of  reliability  for  the 
receiver  is  determined  by  summing  the  part  results. 

Example:  Aircraft  Receiver  Airborne  Active  Failure 
Rate  to  Captive  Carry  Passive  Failure  Rate 


Device 

Qty. 

Xa 

Xt 

Conversion 

Factor 

Xp 

1C 

25 

0.06 

1.50 

.06 

.090 

Diode 

50 

0.001 

0.05 

.05 

.003 

Transistor 

25 

0.002 

0.05 

.06 

.003 

Resistor 

too 

0.002 

0.20 

.06 

.012 

Capacitor 

too 

0.008 

0.80 

.10 

.080 

Switch 

25 

0.02 

0.50 

.20 

.100 

Relay 

10 

0.40 

4.00 

.20 

.800 

Transformer 

2 

0.05 

0.10 

.20 

.020 

Connector 

3 

1.00 

3.00 

.005 

.015 

PCB 

1 

0.70 

0.70 

.02 

.014 

TOTALS 

— 

— 

10.9 

— 

1.137 

Xa  =  Part  (Active)  Failure  Rate  (Failures  per  Million  Hours) 

Xj  =  Total  Part  (Active)  Failure  Rate  (Failures  per  Million  Hours) 

Xp  =  Part  (Passive)  (Dormant)  Failure  Rate  (Failures  per  Million  Hours) 

Mean-Time-Between-Failure  (Active)  =  92,000  hours 

Mean-Time-Between-Failure  (Passive)  =  880,000  hours 
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Table  A16>1 :  Dormant  Conversion  Factors 
(Multiply  Active  Failure  Rate  by) 
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Topic  A17:  Software  Reliability  Prediction  and  Growth 

Software  failures  arise  from  a  population  of  software  faults.  A  software  fault  (often 
called  a  *bug”)  is  a  missing,  extra,  or  defective  code  that  has  caused  or  can 
potentially  cause  a  failure.  Every  time  a  fault  is  traversed  during  execution,  a  failure 
does  not  necessarily  ensue:  it  depends  on  the  machine  state  (values  of 
intermediate  variables).  The  failure  rate  of  a  piece  of  software  is  a  function  of  the 
number  and  location  of  faults  in  the  code,  how  fast  the  prc^ram  is  being  executed, 
and  the  operational  profile.  While  most  repair  activity  is  imperfect,  the  hoped-for 
and  generally  observed  result  is  that  the  times  between  failures  tend  to  grow  longer 
and  longer  as  the  process  of  testing  and  fault  correction  goes  on.  A  software 
reliability  growth  model  mathematically  summarizes  a  set  of  assumptions  about  the 
phenomenon  of  software  failure.  The  model  provides  a  general  form  for  the  failure 
rate  as  a  function  of  time  and  contains  parameters  that  are  determined  either  by 
prediction  or  estimation. 

The  following  software  reliability  prediction  and  growth  models  are  extracted  from 
Rome  Laboratory  Technical  Report  RL-TR-92-15,  'Reliability  Techniques  For 
Combined  Hardware  and  Software  Systems.*  These  models  can  be  used  to 
estimate  the  reliability  of  initially  released  software  along  with  the  reliability 
improvement  which  can  be  expected  during  debugging. 

Initial  Software  Failure  Rate 

nK  Wo 

Xo  =  — j —  failures  per  CPU  second 
where 

rj  =  host  processor  speed  (instructions/sec) 

K  =  fault  exposure  ratio  which  is  a  function  of  program  data  dependency 
and  structure  (default  =  4.2  x  f  0'^) 

Wo  =  estimate  of  the  total  number  of  faults  in  the  initial  program 
(default  =  6  faults/1000  lines  of  code) 

I  =  number  of  object  instoictions  which  is  determined  by  number  of 
source  lines  of  code  times  the  expansion  ratio 


Programming  Language  Expansion  Ratio 


Assembler  1 

Macro  Assembler  1.5 

C  2.5 

COBOL  3 

FORTRAN  3 

JOVIAL  3 

Ada  4.5 
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Software  Reliability  Growth 


X(t) 

where 

Mt) 

Xq 

t 

P 


P 


Xoe-IPtl 


software  failure  rate  at  time  t  (in  CPU  time) 
initial  software  failure  rate 
CPU  execution  time  (seconds) 


decrease  in  failure  rate  per  failure  occurrence 


B 


lo- 

Wo 


B  =  fault  reduction  factor  (default »  .955) 

Wo  initial  number  of  faults  in  the  software  program  per  1 ,000 
lines  of  code 


Example  1 :  Estimate  the  initial  software  failure  rate  and  the  failure  rate  after 
40,000  seconds  of  CPU  execution  time  for  a  20,000  line  Ada  program: 

rj  =2  MIPS  =  2,000,000  instnjctlons/sec 

K  =  4.2x10-7 

Wo  =  (6  faults/1 000  lines  of  code)  (20,000  lines  of  code)  - 1 20  Faults 

I  =  (20,000  source  lines  of  code)  (4.5)  =  90,000  instructions 

,  _  (2,000.000  inst./sec)  (4.2  x  10-7)  (120  faults) 

^  ■  90,000  inst. 


Xo  =  .001 12  failures/CPU  second 

R  B  2^  I  oKKx  ..001 12  failures/sec  « 

P  -  ^  120  faults  ’ 

P  =  8.91  X  10"®  failures/sec 

X  (40,000)  =  .001 1 2  e-l  X  ■>  O'®  failures/sec)  (40,000  sec)] 
X  (40,000)  =  .000784  failures/CPU  second 
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Insight 

A  well  tailored  reliability  and  maintainability  program  contains  several  forms  of 
testing.  Depending  on  the  prr^ram  constraints,  a  program  should  be  invoked  to 
mature  the  desigri!^  in  reliability  as  well  as  to  determine  whether  the  contract 
quantitative  reliability  and  maintainability  requirements  have  been  achieved  prior  to  a 
commitment  to  production.  All  forms  of  testing  (Environmental  Stress  Screening 
(ESS),  Reliability  Growth,  Reliability  Demonstration)  must  be  tailored  to  fit  specific 
program  constraints.  Test  plans  and  procedures  must  be  evaluated  to  ensure 
proper  test  implementation.  Test  partic^ation  depends  on  the  program  situation 
but  test  reports  must  be  carefully  evaluated  by  the  government. 


For  More  Information 


MIL-STD-471 

MIL-STD-781 

MIL-HDBK-781 

DoD-HDBK-344 

MIL-HDBK-189 

RADC-TR-86-241 

RADC-TR-89-160 

RADC-TR-89-299 

RADC-TR-90-269 

RL-TR-91-300 


"Maintainability  Verification/Demonstration  /Evaluation” 

"Reliability  Testing  for  Engineering  Development, 
Qualification  and  Production" 

"Reliability  Test  Methods,  Plans,  and  Environments  for 
Engineering  Development,  Qualification,  and  Production" 

"Environmentai  Stress  Screening  of  Electronic 
Equipment" 

"Reliability  Growth  Management" 

"Buitt-ln-Test  Verification  Techniques" 

"Environmental  Extreme  Recorder 

"Reliability  &  Maintainability  Operational  Parameter 
Translation  II 

"Quantitative  Reliability  Growth  Factors  for  ESS" 

"Evaluation  of  Quantitative  Environmental  Stress 
Screening  (ESS)  Methods" 
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Topic  T1:  ESS  Process 

Environmental  Stress  Screening  (ESS)  has  been  the  subject  of  many  recent 
studies.  Determination  of  the  optimum  screens  for  a  particular  product,  built  by  a 
particular  manufacturer,  at  a  given  time  is  an  iterative  process.  Procedures  for 
planning  for  and  controlling  the  screening  process  are  contained  in  DOO-HDBK- 
344  (USAF),  "Environmental  Stress  Screening  of  Electronic  Equipment."  The 
process  can  be  depicted  as  shown  below: 


Figure  T1>1;  ESS  Process 
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TESTING- TOPIC  T2 


Topic  T2: 

ESS  Placement 

L«V«I  of 

Assombly 

Advantages 

Disadvantages 

Assombly 

•  Cost  per  flaw  precipitated  is 
lowest  (unpowered  screens) 

*  Smal  size  permits  batch 
screening 

•  Low  thermal  mass  allows 
high  rates  of  temperature 
change 

*  Temperature  range  greater 
than  operating  range 
ailowabie 

•  Test  detection  efficiency  is 
relatively  low 

•  Test  equipment  cost  for 
powered  screens  is  high 

Unit 

•  Relatively  easy  to  power  and 
monitor  performance  during 
screen 

•  Higher  test  detection 
efficiency  than  assembly 
level 

•  Ascembly  interconnections 
(e.g.,  wiring  backplane)  are 
screened 

•  Thermal  mass  precludes 
high  rates  of  change  or 
requires  costly  facilities 

•  Cost  per  flaw  significantly 
higher  than  assembly  level 

•  Temperature  range  reduced 
from  assembly  level 

System 

•  All  potential  sources  of  flaws 
are  screened 

•  Unit  interoperability  flaws 
detected 

•  High  test  detection 
efficiency 

•  Difficult  and  costly  to  test  at 
temperature  extremes 

•  Mass  precludes  use  of 
effective  vibration  screens  or 
makes  use  costly 

•  Cost  per  flaw  is  highest 
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Topic  T3:  Typical  ESS  Profile 


Screen  Type.  Parameter 
and  Conditiona 

Aeeembllee  (Printed 
Wiring  Aeeembllee) 
(SRU)* 

Equipment  or  Unit 
(LRU/LRM)* 

Thermal  Cycling  Screen 

Temperature  Range 
(Minimum)  (See  Note  1 ) 

From -50“C  to +  75*0 

From-40‘’Cto+71“C 

Temperature  Rate  of  Change 
(Minimum) 

(See  Notes  1  &  2) 

20°C/M!nute 

IS^C/Minute 

Temperature  Dwell  Duration  (Gee 
Note  3) 

Until  Stabilization 

Until  Stabilization 

Temperature  Cycles 

20  to  40 

12  to  20 

Power  On/Equipment  Operating 

No 

(See  Note  5) 

Equipment  Monitoring 

Mo 

(See  Note  6) 

Electrical  Testing  After  Screen 

Yes  (At  Ambient 
Temperature) 

Yes  (At  Ambient 
Temperature) 

Random  Vibration 
(See  Notes  7  and  8) 

Acceleration  Level 

6Grms 

6  G  nms 

Frequency  Limits 

20  -  2000  Hz 

20  -  2000  Hz 

Axes  Stimulated  Serially  or 
Concurrently 

3 

3 

(See  Note  9) 

Duration  of  Vibration  (Minimum) 

•  Axes  stimulated  serially 

•  Axes  stimulated  concurrently 

10  Minutes/Axis 

10  Minutes 

1 0  Minutes/Axis 

10  Minutes 

Power  On/Off 

Off 

On  (See  Note  5) 

Equipment  Monitoring 

No 

Yes  (See  Note  6) 

Piece  Parts:  Begin  the  manufacturing  and  repair  process  with  100  defects  per  million  or 
less  (See  Note  1 0). 

*SRU  -  Shop  Replaceable  Unit  *LRM  -  Line  Replaceable  Module 

*LRU  -  Line  Replace^le  Unit 
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Notes: 

1 .  All  temperature  parameters  pertain  to  agreed  upon  selected  sample  points  inside  the 
unit  being  screened,  not  chamber  air  temperature. 

2.  Rapid  transfers  of  the  ^uipment  between  one  chamber  at  maximum  temperature  and 
another  chamber  at  minimum  temperature  are  acceptable.  SRU  temperature  rates  of 
change  may  be  reduced  if  equipment  damage  will  occur  at  20‘’C/minute. 

3.  The  temperature  has  stabilized  when  the  temperature  of  the  part  of  the  test  item 
considered  to  have  the  longest  thermal  lag  is  changing  no  more  than  2*0  per  hour. 

4.  A  minimum  of  5  thermal  cycles  must  be  completed  after  the  random  vibration  screen. 
Random  vibration  frequently  induces  incipient  failures. 

5.  Shall  occur  during  the  low  to  high  temperature  excursbn  of  the  chamber  and  during 
vibration.  When  operating,  equipment  shall  be  at  maximum  power  loading.  Power  will  be 
OFF  on  the  high  to  low  temperature  excursion  until  stabilized  at  the  low  temperature. 
Power  will  be  turned  ON  and  OFF  a  minimum  of  three  times  at  temperature  extremes  on 
each  cycle. 

6.  Instantaneous  go/no-go  performance  monitoring  during  the  stress  screen  is  essential 
to  identify  intermittent  failures  when  power  is  on. 

7.  Specific  level  may  be  tailored  to  individual  hardware  specimen  based  on  vibration 
response  survey  and  operational  requirements. 

8.  When  random  vibration  is  applied  at  the  equipment  level,  random  vibration  is  not 
required  at  the  subassembly  level.  However,  subassemblies  purchased  as  spares  are 
required  to  undergo  the  same  random  vibration  required  for  the  equipment  level.  An 
'LRU  mock-up*  or  equivalent  approach  is  acceptable. 

9.  One  axis  will  be  perpendicular  to  plane  of  the  circuit  board(s)/LRM(s). 

10.  The  Air  Force  or  its  designated  contractor  may  audit  part  defective  rates  at  its 

discretion.  The  test  procedure  will  include  thermal  cyding  as  outlined  below.  Sample 
sizes  and  test  requirements  are  included  in  the  'Stress  Screening  Military  Handbook,* 
DOO-HDBK-344. 


Minimum  Temperature  Range 
Minimum  Temperature  Rate  of  Change 


Temperature  Dwell 
Minimum  Temperature  Cydes 
Power  On/Equipment  Monitoring 
Electrical  Testing  After  Screen 


From -54'C  to +100*0 

The  total  transfer  time  from  hot-to-cold  or  cold- 
to-hot  shall  not  exceed  one  minute.  The 
working  zone  recovery  time  shall  be  five 
minutes  maximum  after  introduction  of  the  load 
from  either  extreme  in  accordance  with  MIL- 
STD-883D. 

Until  Stabilization  (See  Note  3) 

25 

No 

Yes  (At  high  and  low  temperatures) 
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Topic  T4:  RGT  and  RQT  Application 

The  Reliability  Qualification  Test  (RQT)  is  an  “accounting  task*  used  to  measure  the 
reliability  of  a  fixed  design  configuration.  It  has  the  benefit  of  holding  the  contractor 
accountable  some  day  down  the  road  from  his  initial  design  process.  As  such,  he  is 
encouraged  to  seriously  carry  out  the  other  design  related  reliability  tasks.  The 
Reliability  Growth  Test  (RGT)  is  an  *engineering  task*  designed  to  improve  the 
design  reliability.  It  recognizes  that  the  drawing  board  design  of  a  complex  system 
cannot  be  perfect  from  a  reliability  point  of  view  and  allocates  the  necessary  time  to 
fine  tune  the  design  by  finding  problems  and  designing  them  out.  Monitoring, 
tracking  and  assessing  the  resulting  data  gives  insight  into  the  efficiency  of  the 
process  and  provides  nonreliability  persons  with  a  toot  for  evaluating  the 
development's  reliability  status  and  for  reallocating  resources  when  necessary.  The 
forms  of  testing  serve  very  different  purposes  and  complement  each  other  in 
development  of  systems  and  equipments.  An  RGT  is  not  a  substitute  for  an  RQT,  or 
other  reliability  design  tasks. 

Table  T4-1:  RGT  and  RQT  Applicability  as  a  Function  of 
System/Program  Constraints 


1 

System/Program 

Parameter 

Reliability  Growth  Test 
Apply  Consider  Don't  Apply 

Reliability  Qualification 
Test 

Apply  Consider  Don't  Apply 

Challenge  to  state-of- 
the-art 

X 

X 

Severs  use  environment 

X 

X 

One-of-a-kind  system 

X 

X 

High  quantities  to  be 
produced 

X 

X 

Benign  use  environment 

X 

X 

Critical  mission 

X 

X 

Design  flexibility  exists 

X 

X 

No  design  flexibility 

X 

X 

Time  limitations 

X 

X 

Funding  limitations 

X 

X 

Very  high  MTBF  system 

X 

X 
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Note:  See  Appendix  5  for  Summary  of  MIL-HDBK-781  Test  Plans. 


TESTING- TOPIC  T6 


Topic  T6:  Maintainability  Demonstration 
Plan  Selection 


Pragrmm  CoiMiralnIs 


Tmi 

CtwradMtetlc 

Calendar  Time 
Required 

Number  of 

Equipments 

Avsifite 

TestFsdlty 

Umitalions 

Level  of 

llalnlalnaMllty 

Required 

Deebed 

ConMenoebi 

ReeuKe 

Rxed  sample 
size  or 

sequential  type 
tesb 

Much  less  than 
that  required  tor 
reliabiliN 
demo.  Time 
required  is 
proportional  to 
sample  size 
number. 

Sample  size 
may  vary 
depencfngon 
program. 

No  effect  on 
sample  size 
number. 

No  effect  on 
sample  size 
number. 

Rxed  sample 
size  test  gives 
dettwnsIralBd 
maintainability 
to  desired 
confidence. 
Sequential  is 
test  of 
hypothesis. 

Test  plan  risks 

Lower  producer 

Must  have 

NoefiBcton 

Higher 

(consumer  and 

and  consumer 

abiityto 

sample  size 
number. 

confidence 

producer)  (1  - 
consumer  risk 
confidence) 
Risks  can  be 
tailored  fc> 
program 

risks  require 
larger  sample 
sizes  than 
higher  risks. 

simulate 

operational 

maintanarKre 

environment, 

scenario, 

skills,  levels 

available. 

levels  require 
more  samples 
than  lower 
confidenoe 
levels. 

Note:  Demonstration  facility  must  have  capacity  for  insertion  of  simulated  faults. 
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Topic  T7:  Tostability  Demonstration  Pian  Seieetion 


Program  Conelralnla 

Teel 

Charaolarielle 

CatomtarThne 

Required 

Number  of 

Equlpmenla 

Avatihls 

TaalFacMly 

Umlttlione 

Basked _ 

Confldenoe  In 
Reeidie 

Fixed  sample 
size  type  lasts 

Calendar  lime  much 
lees  dian  that 
required  for 
reliability 
demon^ration. 

Time  required  is 
proportional  to 
sample  size,  fifiay 
vary  deperKfng  on 
program. 

No  effect  on  sample 
size  number. 

Sameaafiral 

leqpiredfDr 

maintainbbilHy 

demonstration. 

PiovideBior 
producer^  risks  of 
10%.  Provides 
consumer 
assurance  ttiat 
desimwilh 
significant 
deviations  from 
specified  values  will 
beiejeclsd. 

Preset  Risks 
(consumer  arxi 
producer)  (1  • 
consumer  risk 
= confidence) 

Risks  inversely 
proportional  to 
sample  size  used. 

Notes: 

1 .  Sample  size  dependent  on  total  number  of  sample  maintenance  tasks  selected  as  per 
paragraph  A.10.4  of  MIL-STD-471A. 

2.  Demonstration  facility  must  have  capability  for  insertion  of  simulated  faults. 
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Topic  T8:  FRACAS  (Failure  Reporting  and 
Corrective  Action  System) 

Early  elimination  of  failure  trends  is  a  major  contributor  to  reliability  growth  and 
attaining  the  needed  operational  reliability.  To  be  effective,  a  closed  loop 
coordinated  process  must  be  implemented  by  the  system/equipment  contractor.  A 
description  of  the  major  events  and  the  participant’s  actions  is  shown  below. 


Event 


Functions  Actions 


i 


i 


Failure  Ckarrection 


i 


Post  Data  Review 


OperakMs: 

Maintenanoe: 

Quality: 

MaimanarKse; 

Quality: 

R&M: 

R&M: 

Design: 

R&M: 

Physics  of  Failure: 

Quality: 

Design: 

Vendor. 

Quality: 

RSM: 


•  ktentiiy  a  proM^,  call  for  mafotanance, 
annotate  the  incident 


•  Conects  the  problem,  logs  the  failure. 


•  Inspects  the  conection. 

‘  Generates  the  falure  report  with 

supporting  date  (time,  place,  equipment 
item,  etc.) 

•  Insures  completeness  and  assigns  a 
travel  teg  for  the  failed  item  for  audft 
control. 

•  Log  al  the  failure  teporte,  validate  the 
failures  and  forms,  classify  the  falures 
(Inherent  induced,  false  alarm). 


•  Determine  failure  trends  (i.e.,  several 
failures  of  the  same  or  similar  part). 

•  Review  operating  procedures  for  error. 

•  Decide  which  parts  will  be  destnictively 
analyzed. 

•  Perform  failure  analysis  to  determine  the 
cause  of  failure  (i.e.,  part  or  external). 

•  Inspect  incoming  test  date  for  the  part 

•  Redesign  hardware,  if  necessary. 

•  New  part  or  new  test  procedure. 

•  Evaluate  incoming  test  procedures, 
inspect  redesigns  haroware. 

•  Close  the  loop  by  oolecling  and 
evaluating  post  test  date  for  reoccurrence 
of  the  failure. 


Figure  T8-1:  Failure  Reporting  System  Flow  Diagram 
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Table  T8*1:  FRACAS  Evaluation  Checklist 

Topic 

Items  to  Be  Addressed 

General 

•  Closed  loop  (i.e.,  reported,  analyzed,  corrected  and 
verified) 

•  Responsibility  assigned  for  each  step 

•  Overall  control  by  one  group  or  function 

•  Audit  trail  capability 

•  T ravel  tags  for  all  failed  items 

•  Fast  tum-around  for  analysis 

Failure  Report 

•  Clear  description  of  each  event 

•  Surrounding  conditions  noted 

•  Operating  time  indicated 

•  Maintenance  repair  times  calculated 

•  Built-in-test  indications  stated 

Failure  Analysis 

•  Perform  if  three  or  rrore  identical  or  similar  parts  fail 

•  Perform  if  unit  reliability  is  less  than  half  of  predicted 

•  Results  should  indicate:  overstress  condition, 
manufacturing  defect,  adverse  environmental 
condition,  maintenance  induced  or  wearout  failure 
mode 

Failure  Data 

•  Collated  by  week  and  month  by  unit 

•  Compared  to  allocated  values 

•  Reliability  growth  tracked 

•  Problems  indicated  and  tracked 

•  Correction  data  collected  for  verification 
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Topic  T9:  Reliability  Demonstration  Test 

Plan  Checklist* 

Topic 

Itema  to  Be  Addreaaed 

Purposo  and  Scope 

•  Statement  of  overall  test  objectives 

•  General  description  of  all  tests  to  be  performed 

Rafaranca 

Documanta 

•  List  all  applicable  reference  documents 

Taat  Facllltlaa 

•  Description  of  test  item  configuration 

•  Sketches  of  system  layout  during  testing 

•  Serial  numbers  of  units  to  be  tested 

•  General  description  of  test  facility 

•  Test  safety  features 

•  Identification  of  test  location 

•  General  description  of  failure  analysis  facility 

•  Security  of  test  area 

•  Security  of  test  equipment  and  records 

•  Test  safety  provisions 

Taat  Raquiramanta 

•  Pre-reliability  environmental  stress  screening  (ESS) 

•  Test  length 

•  Number  of  units  to  be  tested 

•  Number  of  allowable  failures 

•  Description  of  MIL-HDBK-781  test  plan  showing  accept,  reject 
and  continue  test  requirements 

•  List  of  government  furnished  equipment 

•  List  and  schedule  of  test  reports  to  be  issued 

Teat  Schedule 

•  Start  data  (approximate) 

•  Finish  date  (approximate) 

•  Test  program  review  schedule 

•  Number  of  test  hours  per  day 

•  Number  of  test  days  per  week 

Teat  Conditions 

•  Description  of  thermal  cycle 

•  Description  of  thermal  survey 

•  Description  of  vbration  survey 

•  Description  of  unit  under  test  mounting  method 

•  Description  of  test  chamber  capabilities 

•  List  of  all  limited  life  items  and  their  expected  life 
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Topic 


Itams  to  Bo  Addrossod 


Description  of  all  preventive  maintenance  tasks  and 
their  frequency 

Description  of  unit  under  test  calibratbn  requirements 

Description  of  unit  under  test  duty  cycle 

General  description  of  unit  under  test  operating  modes  and 
exercising  method 

Description  of  test  software  and  software  verification  method 

List  of  all  units  under  test  functions  to  be  monitored  and 
monitoring  method 

List  of  all  test  equipment  parameters  to  be  monitored  and 
monitoring  method 

Method  and  frequency  of  recording  all  monitored  parameters 
Test  Participation  •  Description  of  all  contractor  functions 

•  Description  of  all  contractor  responsibilities 

•  Description  of  all  government  responsibilities 

•  Description  of  test  management  structure 

Failure  Definitions  The  following  types  of  failures  should  be  defined  as  relovant  in 
the  test  plan: 

•  Design  defects 

•  Manufacturing  defects 

•  Physical  or  functional  degradation  below  specification  limits 

•  Intermittent  or  transient  failures 

•  Failures  of  limited  life  parts  which  occur  before  the  specified 
life  of  the  part 

•  Failures  which  cannot  be  attributed  to  a  specific  cause 

•  Failure  of  built-in-test  (BIT) 


Test  Conditions 
(cont'd) 


Test  Monitoring 


The  following  types  of  failures  should  be  defined  as  nonmlevant 

in  the  test  plan: 

•  Failures  resulting  from  improper  installation  or  handling 

•  Failure  of  instrumentation  or  monitoring  equipment  which  is 
external  to  equipment  under  test 

•  Failures  resulting  from  overstress  beyond  specification  limits 
due  to  a  test  facility  fault 

•  Failures  resulting  from  procedural  error  by  technicians 

•  Failures  induced  by  repair  actions 

•  A  secondary  failure  which  is  the  direct  result  of  a  failure  of 
another  part  within  the  system. 
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Topic 

Items  to  Be  Addressed 

Test  Ground  Rules 

The  following  test  ground  rules  should  be  stated  in  the  test  plan; 

•  Transient  Failures  •  Each  transient  or  intermittent  failure  is  to 
be  counted  as  relevant.  H  several  intermittent  or  transient 
failures  can  be  directly  attributed  to  a  single  hardware  or 
software  malfunction  which  is  corrected  and  verified  during 
the  test,  then  only  a  single  failure  will  be  counted  as  relevant. 

•  Classification  of  Failures  -  All  failures  occurring  during 
reliability  testing,  after  contractor  failure  analysis,  shall  be 
classified  as  either  relevant  or  nonrelevant.  Based  on  the 
failure  analysis,  the  contractor  shall  justify  the  failure  as 
relevant  or  nonrelevant  to  the  satisfaction  of  the  procuring 
activity. 

•  Pattern  Failure  -  A  pattern  failure  is  defined  as  three  or  more 
relevant  failures  of  the  same  part  in  identical  or  equivalent 
applications  whose  95th  percentile  lower  confidence  limit 
failure  rate  exceeds  that  predicted. 

•  Malfunctions  Observed  Durirtg  Test  Set  Up,  Troubleshooting 
or  Repair  Verification  -  Malfunctions  occurring  during  test  set 
up,  troubleshooting  or  repair  verification  tests  shall  not  be 
considered  as  reliability  test  failures;  however,  such 
malfunctions  shall  be  recorded  and  analyzed  by  the 
contractor  to  determine  the  cause  of  malfunctions  and  to 
identify  possible  design  or  part  deficiencies. 

•  Test  Time  Accumulation  •  Only  the  time  accumulated  during 
the  equipment  power  *on*  portion  of  the  test  cycle  shall  be 
considered  as  test  time,  provided  that  all  functions  are 
operating  as  required.  Operating  time  accumulated  outside 
the  operational  cycles  such  as  during  tests  performed  to 
check  out  the  setup  or  to  verify  repairs  shall  not  be  counted. 
Also,  time  accumulated  during  degraded  modes  of  operation 
shall  not  be  counted. 

•  Design  Changes  to  the  Equipmet^: 

-  After  test  reject  decision — With  procuring  activity 
approval,  the  equipment  may  be  redesigned  and  retested 
from  time  zero. 

Major  design  change  prior  to  test  reject — ^The  contractor 
may  stop  the  test  for  purposes  of  correcting  a  major 
problem.  The  test  will  restart  from  time  zero  after  the 
design  change  has  been  made. 

-  Minor  design  change  prior  to  test  reject— With  procuring 
activity  approval,  the  test  may  be  halted  for  the  purpose  of 
making  a  minor  design  change.  Test  time  will  resume  from 
the  point  at  which  it  was  stopped  and  the  design  change 
shall  have  no  effect  on  the  classification  of  previous 
failures.  Minor  changes  made  as  a  result  of  other  testing 
may  be  incorporated,  with  procuring  activity  approval, 
without  dedaring  a  failure  of  the  equipment  under  test. 
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Topic 

items  to  Be  Addreeeed 

TMt  Ground  Rulas  •  Failure  Categorization  -  In  order  to  dearly  evaluate  test 
(cont'd)  results  and  identify  problem  areas,  failure  causes  will  be 

categorized  as:  (1)  deficient  system  design,  (2)  deficient 
system  quality  control,  and  (3)  deficient  part  design  or  quality. 

Test  Logs  The  following  types  of  test  logs  should  be  described  in  the  test 

plan: 

•  Equipment  Data  Sheets  -  used  to  record  the  exact  values  of 
all  parameters  measured  during  functional  testing  of  the 
equipment. 

•  Test  Log  -  a  comprehensive  narrative  record  of  the  required 
test  events.  All  names  and  serial  numbers  of  the  equipments 
to  be  tested  shall  be  listed  before  start  of  the  test.  An  entry 
shall  be  made  in  the  test  log  each  time  a  check  is  made  on  the 
equipment  under  test,  including  data,  time,  elapsed  time,  and 
result  (e.g.,  pass/matfunction  indication/failure  or  etc.).  An 
entry  shall  be  mads  in  the  log  whenever  a  check  is  mads  cH  the 
test  facilities  or  equipments  (such  as  accelerometers, 
thermocouples,  input  power,  self-test,  etc.).  In  the  event  of  a 
failure  or  malfunction  indication,  all  pertinent  data,  such  as 
test  conditions,  fax^ility  conditions,  test  parameters  and  failure 
indicators,  will  be  recorded.  The  actions  taken  to  isolate  and 
correct  the  failure  shall  also  be  recorded.  Whenever 
engineering  changes,  or  equipment  changes  are  implemented, 
an  entry  shall  be  made  in  the  log. 

•  Failure  Summary  Record  -  the  failure  summary  record  must 
chronologically  list  all  failures  that  occur  during  the  test.  This 
record  must  contain  all  the  information  need^  to  reach  an 
accept  or  reject  decision  for  the  test.  Each  failure  must  be 
desaibed  and  ail  failure  analysis  data  must  be  provided. 

•  Failure  Report  -  for  each  failure  that  occurs,  a  failure  report 
must  be  initiated.  The  report  should  contain  the  unit  that 
failed,  serial  number,  time,  data,  symptoms  of  failure  and  part 
or  parts  that  failed . 


*Most  of  these  contents  also  apply  to  reliability  growth  testing. 
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Topic  T10: 

Roliablllty  Toot  Proecduro  Ctioekliot 

Topic 

Itama  to  Be  Addraaaad 

Equipmont 

Operation 

A  general  description  of  the  equipment  under  test  and  its 
operation  must  be  provided. 

On/Off  Cyela 

Specific  on/off  times  for  each  subsystem  must  be  desertoed. 

Operation  Modae 

Specific  times  of  operation  for  each  system/subsystem  mode 
must  be  described. 

Exarciaing 

Mathoda 

Methods  trf  exercising  ail  systam/subsystem  operation  modes 
must  be  described.  (Note:  The  system  should  be  exercised 
continuously,  not  just  power  on). 

Performance 

Verification 

Procadura 

Step  by  step  test  procedures  must  be  provided  which  fully 
describe  how  and  when  each  performance  parameter  will  be 
measured.  Acceptable  and  unacceptable  limits  of  each 
measured  parameter  should  also  be  sfMcified.  All  failure  and 
out-of-toleranca  indicators  must  be  described  and  their 
location  defined.  Programmable  alarm  thresholds  must  be 
specified. 

Failure  Event 
Procadura 

Step  by  step  procedures  must  describe  specific  actions  to  be 
taken  in  the  event  of  a  trouble  indicatbn. 

Adjuatmanta  am 

Preventive 

Maintenance 

Step  by  step  procedures  must  be  provided  which  fully  deserbe 
how  and  when  all  adjustments  and  preventive  maintenance 
actions  will  be  performed. 
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Topic  Til:  Maintainability  Demonstration  Plan 
and  Procedure  Checklist 


Topic  Homs  to  B«  Addrossod 

Purposa  and  •  Statement  of  general  test  objectives 

Scope  •  General  description  of  test  to  be  performed 

Rafarenca  •  List  of  all  applicable  reference  documents 

Documanta 

Teat  Facllltlaa  •  Description  of  test  item  configuration 

•  Sketches  of  system  layout  during  testing 

•  Serial  numbers  of  units  to  be  tested 

•  General  description  of  site  and  test  facilKy 

•  Description  of  ai>  software  and  test  equipment 

Teat  •  Description  of  MIL-STD-471  test  plan  requirements 

Requirements  •  Method  of  generating  candidate  fault  list 

•  Method  of  selecting  and  injecting  faults  from  candidate 
list 

•  List  of  government  furnished  equipment 

•  List  and  schedule  of  test  reports  to  be  issued 

•  Levels  of  maintenance  to  be  demonstrated 

•  Spares  and  other  support  material  requirements 

Test  Schedule  •  Start  and  finish  dates  (approximate) 

•  Test  program  review  schedule 

Test  Conditions  •  Description  of  environmental  conditions  under  which  test 

will  be  performed 

•  Modes  of  equipment  operation  during  testing 

Test  Monitoring  •  Method  of  monitoring  and  recording  test  results 

Test  Participation  •  Test  team  members  and  assignments 

•  Test  decision  making  authority 

Test  Ground  •  Instrumentation  failures 

Rules  with  .  Maintenance  due  to  secondary  failures 

Respect  to  .  jechnical  manual  usage  and  adequacy 

•  Maintenance  inspection,  time  limits  and  skill  level 

Testa  b  1 1  ity  •  Repair  levels  for  which  requirements  will  be  demonstrated 

Demonstration  .  Built-in-test  requirements  to  be  demonstrated 

•  External  tester  requirements  to  be  demonstrated 

•  Evaluat'on  method  for  making  pass/fail  decisbn 

•  Performance  of  FMEA  prior  to  test  start 

•  Method  of  selecting  and  simulating  candidate  faults 

•  Acceptable  levels  of  ambiguity  at  each  repair  level 
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Topic  T12:  Reliability  and  Maintainability  Test 
Participation  Criteria 

Degree  of  Participation  Depends  On: 

•  Availability  of  program  resources  to  support  on-site  personnel 

•  How  important  R&M  are  to  program  success 

•  Availability  and  capability  of  other  government  on-site  personnel 

Test  Preiiminaries 

•  All  test  plans  and  procedures  must  be  approved 

•  Agreements  must  be  made  among  government  personnel  with  respect  to 
covering  the  test  and  incident  reporting  procedures 

•  Units  under  test  and  test  equipment  including  serial  numbers  should  be 
documented 

•  Working  fire  alarms,  heat  sensors  and  overvoltage  alarnis  should  be  used 

•  Trial  sunrey  runs  should  be  made  per  the  approved  test  plan 

Test  Conduct 

•  Approved  test  plans  and  procedures  must  be  available  and  strictly  adhered  to 

•  Equipment  must  not  be  tampered  with 

•  Test  logs  must  be  accurately  and  comprehensively  maintained 

•  Appropriate  government  personnel  must  be  kept  informed 

•  Only  authorized  personnel  should  be  allowed  in  area  (a  list  should  be  posted) 

•  Test  logs,  data  sheets,  and  failure  reports  should  be  readily  available  for 
government  review 

•  Units  under  test  should  be  sealed  to  prevent  tampering  or  unauthorized 
repair 

•  A  schedule  of  inspections  and  visits  should  be  maintained 

•  No  repairs  or  replacements  should  be  made  without  a  government  witness 

•  Government  representatives  must  take  part  in  failure  review  process 

•  Failed  items  should  have  “travel  tags"  on  them 

•  Technical  order!?  should  be  used  for  repair  if  available 
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Topic  T13:  Reliability  and  Maintainability 
Demonstration  Reports  Checklist 

•  Identification  and  description  of  equipment/system 
tested 


•  Demonstration  objectives  and  requirements 

•  Test  Plans,  Risks  and  Times  •  Test  Conditions 

•  Test  Deviations  and  Risk  •  Test  Facilities 

Assessment 


•  Data  Anaiysis  Techniques 

•  Statistical  Equations  •  Accept/Reject  Criteria 


Test  Resuits  (Summarized) 

Reliability  Maintainability 

•  Test  Hours  •  Maintenance  Tasks  Planned  and 

Selected 


Number  of  Failures/Incidents 

Classification  of  Failures 

Data  Analysis  Calculations 

Application  of  Accept/Reject 
Criteria 

Failure  Trends/Design  and 
Process  Deficiencies 

Status  of  Problem  Conreclbns 


Task  Selection  Method 

Personnel  Qualifications 
Performing  Tasks 

Documentation  Used  During 
Maintenance 

Measured  Repair  Times 

Data  Analysis  Calculalions 

Application  of  Accept/Reject 
Criteria 

Discussion  of  Deficiencies 
Identified 


Testability 

•  Summary  data  for  each  item  involved  in  testability  demonstration 
including  original  plans,  summarized  results  and  any  corrective  action 
taken. 

•  Recommended  action  to  be  taken  to  remedy  testability  deficiencies  or 
improve  the  level  of  testability  achievable  through  prime  equipment 
engineering  changes,  ATE  improvements  and/or  test  program  set 
improvements. 

•  Data 

•  Test  Logs  and  Failure  Reports 

•  Failure  Analysis  Results 
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Topic  T14:  Design  of  Experiments 

Design  of  Experiments  is  a  very  efficient,  statisticaily  based  method  of  systematically 
studying  the  effects  of  experimental  factors  on  response  variables  of  interest.  The 
efficiency  is  achieved  through  greatly  reduced  test  time  because  the  effects  of  vary¬ 
ing  multiple  input  factors  at  once  can  be  systematically  studied.  The  technique  can 
be  applied  to  a  wide  variety  of  product  design,  process  design,  and  test  and  evalua¬ 
tion  situations.  Many  books  have  been  written  on  various  experimental  design 
strategies  which  cannot  possibly  be  addressed  in  these  few  pages.  It  is  the  intent 
of  this  section  only  to  give  the  reader  a  brief  introduction  to  Design  of  Experiments 
by  providing  a  single  numerical  example  of  what  is  called  a  fractional  factorial  design. 
Some  other  competing  design  strat^ies,  each  with  their  own  strengths  or  weak¬ 
nesses,  include  Full  Factorial,  Plackett-Burman,  Box-Burman,  and  Taguchi. 

Improved  levels  of  reliability  can  be  achieved  through  the  use  of  Design  of 
Experiments.  Design  of  Experiments  allows  the  experimenter  to  examine  and 
quantify  the  main  effects  and  interactions  of  factors  acting  on  reiiability.  Once  identi¬ 
fied,  the  main  factors  affecting  reliability  (some  of  which  may  be  uncontrollable,  such 
as  weather)  can  be  dealt  with  systematically  and  scientifically.  Their  adverse  effects 
on  the  system  design  can  be  minimized,  thereby  meeting  performance 
specifications  while  remaining  insensitive  to  uncontrollable  factors.  The  following 
example  illustrates  the  general  procedure  and  usefulness  of  Design  of 
Experiments.  The  example  is  broken  down  into  a  series  of  steps  which  illustrate  the 
general  procedure  of  designing  experiments. 

Example:  Fractional  Factorial  Design 

An  integrated  circuit  manufacturer  desired  to  maximize  the  bond  strength  of  a  die 
mounted  on  an  insulated  substrate  since  it  was  determined  that  bonding  strength 
problems  were  resulting  in  many  field  failures.  A  designed  experiment  was  con¬ 
ducted  to  maximize  bonding  strength. 

Step  1  -  Determine  Factors:  it  isn't  always  obvious  which  factors  are 
important.  A  good  way  to  select  factors  is  through  organized  'brainstorming*. 
Ishikawa  charts  (see  Introduction)  are  helpful  in  organizing  cause  and  effect  related 
data.  For  our  example,  a  brainstorming  session  was  conducted  and  four  factors 
were  identified  as  affecting  bonding  strength;  (1 )  epoxy  type,  (2)  substrate  material, 
(3)  bake  time,  and  (4)  substrate  thickness. 

Step  2  -  Select  Test  Settings:  Often,  as  with  this  example,  high  and  low 
settings  are  selected.  This  is  referred  to  as  a  two-level  experiment.  (Design  of 
Experiments  techniques  are  often  used  for  more  than  two-level  experiments.)  The 
four  factors  and  their  associated  high  and  low  settings  for  the  exampie  are  shown  in 
Table  T14-1.  The  selection  of  high  and  low  settings  is  arbitrary  (e.g.  Au  Eutectic 
could  be "+"  and  Silver  could  be "-"). 
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Table  T14-1:  Factors  and  Settings 

Factor 

Low  (-) 

Levels 

High  (+) 

A.  Epoxy  Type 

Au  Eutectic 

Silver 

B.  Substrate  Material 

Alumina 

Beryllium  Oxide 

C.  Bake  Time  (at  90°C) 

90  Min 

1 20  Min 

D.  Substrate  Thickness 

.025  in 

.05  in 

Step  3  -  Set  Up  An  Appropriate  Design  Matrix:  For  our  example,  to 
investigate  all  possible  combinations  of  four  factors  at  two  levels  (high  and  low)  each 
would  require  16  (i.e.,  2^)  experimental  runs.  This  type  of  experiment  is  referred  to 
as  a  full  factorial.  The  integrated  circuit  manufacturer  decided  to  use  a  one  half 
replicate  fractional  factorial  with  eight  runs.  This  decision  was  made  in  order  to 
conserve  time  and  resources.  The  resulting  design  matrix  is  shown  in  Table  T14-2. 
The  Table  T14-2  matrix  pattern  is  deveioped  utilizing  a  commonly  known 
Design  of  Experiments  method  called  Yates  algorithm.  The  test  runs  are 
randomized  to  minimize  the  possibility  of  outside  effects  contaminating  the  data. 
For  example,  if  the  tests  were  conducted  over  several  days  in  a  room  where  the 
temperature  changed  siightly,  randomizing  the  various  test  trials  would  tend  to 
minimize  the  effects  of  room  tenperature  on  the  experimental  results.  The  matrix  is 
orthogonal  which  means  that  it  has  the  correct  balancing  properties  necessary  for 
each  factor's  effect  to  be  studied  statistically  independent  from  the  rest. 
Procedures  for  setting  up  orthogonal  matrices  can  be  found  in  any  of  the 
references  cited. 

Step  4  •  Run  The  Tests:  The  tests  are  run  randomly  at  each  setting  shown  in 
the  rows  of  the  array.  The  trial  run  order  is  determined  by  a  random  number  table  or 
any  other  type  of  random  number  generator.  Resultant  bonding  strengths  from 
testing  are  shown  in  Table  T14-2 . 

Table  T14-2:  Orthogonal  Design  Matrix  With  Test  Results 
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Step  5  •  Analyze  The  Reeults:  This  step  involves  performing  statistical 
analysis  to  determine  which  factors  and/or  interactions  have  a  significant  effect  on 
the  response  variable  of  interest.  As  was  done  in  Table  T14-3,  interactions  and 
aliasing  (aliasing  is  defined  as  two  or  more  effects  that  have  the  same  numerical 
value)  patterns  must  be  identified.  The  impact  on  the  response  variable  caused  by 
*A  or  BCD”  cannot  be  differentiated  between  factor  A  or  the  interaction  of  BCD. 
This  is  the  penalty  which  is  paid  for  not  performing  a  full  factorial  experiment  (i.e., 
checking  every  possible  combination).  The  determination  of  aliasing  patterns  are 
unique  to  each  experiment  and  are  described  in  many  Design  of  Experiments 
texttxxjks.  The  assumption  is  usually  made  that  3-way  interactions  such  as  BCD  are 
negligible.  An  Analysis  of  Variance  is  then  performed  as  shown  in  Table  T14-4  to 
determine  which  factors  have  a  significant  effect  on  bonding  strength.  The  steps 
involved  in  performing  an  /Vnalysis  of  Variance  for  this  example  are: 

5A.  Calculate  Sum  of  Squares:  From  Table  T14-3  the  Sum-of- 
Squares  for  a  two  level,  single  replk:ate  experiment  is  computed  for  all 
factors  and  interactions  as  illustrated  below  for  the  A  factor  (Epoxy  Type). 

«  #  of  treatment  combinations  .,.,9 

Sum  of  Sq.  (Factor  A)  = - ^ - (Avg(+)-Avg(-))‘‘ 

Sum  of  Sq.  (Factor  A)  =  ®  (2.25)2  =  10.125 

5B.  Calculate  Error:  The  Sum  of  Squares  for  the  error  in  this  case  is  set 
equal  to  the  sum  of  the  Sum  of  Squares  values  for  the  three  two-way 
interactions  (i.e.,  AB  or  CD,  AC  or  BD,  BC  or  AD).  This  is  known  as  pooling 
the  error.  This  error  is  calculated  as  follows:  Error  =  1.125  + 1.125  +  .125  = 
2.375. 

5C.  Determine  Degrees  of  Freedom.  Degrees  of  Freedom  is  the 
number  of  levels  of  each  factor  minus  one.  Degrees  of  Freedom  (df)  is 
always  1  for  factors  and  interactions  for  a  two  level  experiment  as  shown  in 
this  simplified  example.  Degrees  of  Freedom  for  the  error  (dferr)  <n  this  case 
is  equal  to  3  since  there  are  3  interaction  Degrees  of  Freedom,  dfp 
denotes  degrees  of  freedom  for  a  factor. 

5D.  Calculate  Mean  Square.  Mean  Square  equals  the  sum  of  squares 
divided  by  the  associated  degrees  of  freedom.  Mean  Square  for  a  two 
level,  single  replicate  experiment  is  always  equal  to  the  sum  of  squares  for 
all  factors.  Mean  Square  for  the  error  in  this  case  is  equal  to  the  Sum  of 
Squares  error  term  divided  by  3  (3  is  the  df  of  the  error). 

5E.  Perform  F  Ratio  Test  for  Significance.  To  determine  the  F  ratio 
the  mean  square  of  the  factor  is  divided  by  the  mean  square  error  (.792) 
from  Table  T14-4.  F  (a,  dfp.  dferr)  represents  the  critical  value  of  the 
statistical  F-distribution  and  is  found  in  look-up  tables  in  most  any  statistics 
book.  Alpha  (a)  represents  the  level  at  which  you  are  willing  to  risk  in 
concluding  that  a  significant  effect  is  not  present  when  in  actuality  it  is.  If  the 
F  ratio  is  greater  than  the  looked  up  value  of  F  (a^  dfp,  dferr)  then  the  factor 
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does  have  a  significam  effect  on  the  response  variable.  (F  (.1 ,1 ,3)  =  5.54  in 
this  case). 

As  a  word  of  caution,  the  above  formulations  are  not  intended  for  use  in  a  cookbook 
fashion.  Proper  methods  for  computing  Sum  of  Squares,  Mean  Square,  Degrees 
of  Freedom,  etc.  depend  on  the  experiment  type  being  mn  and  can  be  found  in 
appropriate  Design  of  Experiments  reference  b^ks. 

Table  T14-3:  Interactions,  Aliasing  Patterns  and 
Average  "V  and  Values 


Treatment 

Combination 

A  or 
BCD 

B  or  AB  or 
AGO  CD 

C  or 
ABD 

AC  or  BC  or 
BD  AD 

D  or 
ABC 

Bonding 

Strangth* 

y 

1 

- 

+ 

- 

+  + 

73 

2 

- 

+ 

+ 

- 

+ 

88 

3 

- 

+ 

- 

+ 

+ 

81 

4 

- 

+ 

+ 

+ 

- 

77 

5 

+ 

- 

+ 

+ 

83 

6 

+ 

+ 

+ 

- 

81 

7 

+ 

+  + 

- 

- 

- 

74 

8 

+ 

+  + 

+ 

+  + 

+ 

90 

Avg(+) 

82 

80.5  81 .25 

84 

81 .25  80.75 

85.5 

Avg  {-) 

79.75 

81.25  80.5 

77.75 

80.5  81 

76.25 

A  «  Avg(+)  - 

Avg  (-) 

2.25 

-.75  .75 

6.25 

.75  -25 

9.25 

*Thd  mean  bonding  strength  calculated  from  this  column  is  80.875. 

Table  T14-4 

Results  of  Analysis  of  Variance 

Sum  of  Degrees 

of  Mean 

Significant 

Source 

Squares  Freedom  Square  F 

ratio* 

Effect 

Epoxy  Type  (A) 

10.125 

1 

10.125  12.789 

Yes 

Substrate  Material  (B) 

1.125 

1 

1.125 

1.421 

No 

Bake  Time  (C) 

78.125 

1 

78.125  98.684 

Yes 

Substrate  Thickness  (D) 

171.125 

1 

171.125  216.158 

Yes 

A  X  B  or  C  X  0 

1.125 

1 

- 

~ 

~ 

A  X  C  or  B  X  D 

1.125 

1 

“ 

- 

- 

BxCorAxD 

0.125 

1 

- 

- 

- 

Error 

2.375 

3 

.792 

.. 

‘Example  Calculation:  F  = 

Mean  Square/Error »  10.125/.792  =  12.789 
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Step  6  -  Calculate  Optimum  Settinge:  From  the  Analysis  of  Variance,  the 
factors  A,  C,  and  D  were  found  to  be  significant  at  the  10%  level.  In  order  to 
maximize  the  response,  i.e.  bonding  strength,  we  can  determine  optimum  settings 
by  inspecting  the  following  prediction  equation: 

y  -  (mean  bonding  strength)  -t-  2.25A  +  6.25C  +  9.25D 

Since  A,  C,  and  D  are  the  only  significant  terms  they  are  then  the  only  ones  found  in 
the  prediction  equation.  Since  A,  C,  and  D  all  have  positive  coefficients  they  must 
be  set  at  high  to  maximize  bonding  strength.  FsK^tor  B,  substrate  material,  which 
was  found  to  be  nonsignificant  should  be  chosen  based  on  its  cost  since  it  does 
not  affect  bonding  strength.  A  cost  analysis  shouid  always  be  accomplished  to 
assure  that  ail  decisions  resulting  from  designed  experiments  are  cost-effective. 

Step  7  •  Do  Confirmation  Run  Test:  Since  there  may  be  important  factors 
not  considered  or  nonlinear  effects,  the  optimum  settings  must  be  verified  by  test. 
If  they  check  out,  the  job  is  done,  if  not,  some  new  tests  must  be  planned. 

Design  of  Experiments  References: 

Barker,  T.  B.,  "Quality  By  Experimental  Design,"  Marcel  Dekker  Inc.,  1985. 

Box,  G.E.P.,  Hunter.  W.  G.,  and  Hunter.  J.  S.,  "Statistics  for  Experiments,”  John 
Wiley  &  Sons,  New  York,  1978 

Davies,  O.  L.,  "The  Design  and  Analysis  of  Industrial  Experiments,"  Hafner 
Publishing  Co. 

Hicks,  C.R.,  "Fundamental  Concepts  in  the  Design  of  Experiments,"  Holt,  Rinehart 
and  Winston.  Inc,  New  York,  1982 

Schmidt,  S.  R.  and  Launsby,  R.  G.,  "Understanding  Industrial  Designed 
Experiments,"  Air  Academy  Press,  Colorado  Springs  CO,  1989 

Taguchi,  G.,  "Introduction  to  Quality  Engineering,”  American  Supplier  Institute,  Inc, 
Dearborn  Ml,  1986 
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Topic  T15:  Accelerated  Life  Testing 

Accelerated  life  testing  employs  a  variety  of  high  stress  test  methods  that  shorten 
the  life  of  a  product  or  quicken  the  degradation  of  the  prockict's  performance.  The 
goal  of  such  testing  is  to  efficiently  obtain  performance  data  that,  when  properly 
analyzed,  yields  reasonable  estimates  of  the  product’s  life  or  performance  under 
normal  conditions. 

Why  Use  H? 

•  Considerable  savings  of  time  and  money 

•  Quantify  the  relationship  between  stress  and  performance 

•  Identify  design  and  manufacturing  deficiencies 

Why  Not? 

•  Difficulty  in  translating  the  stress  data  to  normal  use  levels 

•  High  stress  testing  may  damage  systems 

•  Precipitated  failures  may  not  represent  use  level  failures 

Test  Methods 

Most  accelerated  test  methods  involving  electronics  are  limited  to  temperature  or 
voltage.  However,  other  methods  have  included:  acceleration,  shock,  humidity, 
fungus,  corrosion,  and  vibration. 

Graphical  Analysis 

The  advantages  are: 

•  Requires  no  statistics 

•  Easily  translates  the  high  stress  data  to  normal  levels 

•  Very  convincing  and  easy  to  interpret  . 

•  Provides  visual  estimates  over  any  range  of  stress 

•  Verifies  stress/performance  relations 
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The  (Ksadvanlages  are: 

•  Does  not  provide  objectiveness 

•  Has  statisticai  uncertainty 

•  Relies  on  an  assumed  relationship  which  may  not  lit  the  data 

Test  Design 

All  test  conditions  should  be  limited  to  three  elevated  stress  levels  (considering 
budget,  schedule,  and  chamber  capabilities)  with  the  following  conditions: 

•  Test  stress  should  exceed  maximum  operating  limits 

•  Test  stress  should  not  exceed  maximum  design  limits 

•  Stress  levels  only  for  normal  use  failure  modes 

Test  Units 

The  units  shall  be  allocated  to  the  particular  stress  levels  so  that  most  of  the  units 
are  at  the  lower  stress  levels  and  fewer  units  at  the  higher.  If  20  test  units  are 
available,  a  reasonable  allocation  would  be  9  units  at  the  lowest  level  and  7  and  4  at 
the  higher  levels.  This  allocation  scheme  is  employed  so  that  the  majority  of  the  test 
data  is  collected  nearest  to  the  operating  levels  of  stress.  Three  units  should  be 
considered  a  minimum  for  the  higher  levels  of  stress;  if  fewer  than  10  units  are 
available  for  test,  design  for  only  two  levels. 

Data  Anaiysis:  Probabiiity  Pint 

The  operational  performance  (time  before  failure  in  most  cases)  of  nearly  all 
electronic  and  electromechanical  systems  can  be  described  by  either  the 
Lognormal  or  Weibull  probability  density  functions  (pdf).  The  pdf  describes  how 
the  percentage  of  failures  is  distributed  as  a  function  of  operating  time.  The 
probability  plot  of  test  data  is  generated  as  follows: 

«  Rank  the  failure  times  from  first  to  last  for  each  level  of  test  stress  (nonfailed 
units  close  out  the  list). 

•  For  each  failure  time,  rank  i,  calculate  its  plotting  position  as: 

Where  n  is  the  total  number  of  units  on  test  at  that  level. 

•  Plot  P  versus  the  failure  time  for  each  failure  at  each  stress  level  on 
appropriate^  scaled  graph  paper  (eittier  Logarithmic  or  Weibull). 
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•  Visually  plot  lines  through  each  set  (level  of  stress)  of  points.  The  lines 
should  plot  parallel,  weighting  the  tendency  of  the  set  with  the  most  data 
heaviest.  If  the  lines  do  not  plot  reasonably  parallel,  investigate  failure  modes. 

Data  Analysis:  Relationship  Plot 

The  relationship  plot  is  constructed  on  an  axis  that  describes  unit  performance  as  a 
function  of  stress.  Two  of  the  most  commonly  assumed  relations  are  the  Inverse 
Power  and  the  Arrhenius  Relationship.  The  relationship  plot  is  done  as  follows; 

•  On  a  scaled  graph,  plot  the  50%  points  determined  from  the  probability  plot 
for  each  test  stress. 

•  Through  these  50%  points,  plot  a  single  line,  projecting  beyond  the  upper 
and  lower  points. 

•  From  this  plot  locate  the  intersection  of  the  piotted  line  and  the  normal  stress 
value.  This  point,  read  from  the  time  axis,  represents  the  time  at  which  50%  of 
the  units  will  fail  while  operating  under  normal  conditions. 

•  Plot  the  time  determined  in  step  three  on  the  probability  plot.  Draw  a  line 
through  this  point  parallel  to  those  previously  drawn.  This  resulting  line 
represents  the  distribution  of  failures  as  they  occur  at  normal  levels  of  stress. 

Example:  Probability  and  Relationship  Plots 

Consider  an  electronic  device  life  test  that  demonstrates  an  Arrhenius 
performance/stress  relationship  that  fails  lognormally  at  any  given  level  of  stress. 
Engineers  wish  to  determine  the  unit's  reliability  (MTBF)  at  90°C  (maximum 
operating  temperature).  There  are  20  units  available  for  test. 

After  reviewing  the  design  and  considering  the  potential  failure  modes,  the 
engineers  concluded  that  the  units  could  survive  at  temperatures  in  excess  of 
230°C  without  damage.  The  engineers  did,  however,  estimate  that  non-regular 
failure  modes  will  be  precipitated  above  this  temperature,  therefore,  230'’C  was 
established  as  the  maximum  test  level  with  150°C  and  180*’C  as  interim  stress  levels. 
The  test  units  were  allocated  to  three  test  levels  and  run  for  1000  hours.  The 
resulting  failure  times  are  shown  in  Table  T15-1. 
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Table  T15-1:  Test  Results 

9  Units  @  150°C  7  Units  ®  180°C  4  Units  ®  23000 


Time  to 
Failure 
(Hrs.) 

Rank 

P 

Time  to 
Failure 
(Hrs.) 

Rank 

P 

Time  to 

Failure 

(Hrs.) 

Rank 

P 

567 

1 

5.5 

417 

1 

7.1 

230 

1 

12.5 

688 

2 

16.6 

498 

2 

21.4 

290 

2 

37.5 

750 

3 

27.7 

568 

3 

35.7 

350 

3 

62.5 

840 

4 

38.8 

620 

4 

50.0 

410 

4 

87.5 

910 

5 

50.0 

700 

5 

64.3 

999 

6 

61.1 

770 

6 

78.6 

— 

7 

— 

863 

7 

92.9 

-  8  - 

^ _ 9  - _ 

*  Unit  still  operating  at  1000  hours 


The  probability  and  relationship  plots  are  shown  in  Figures  T15-1  &  T15-2.  From 
Figure  T15-2  it  is  estimated  that  50%  of  the  units  will  fail  by  3500  hours  while 
operating  at  90°C.  Further,  from  Figure  T15-1,  it  can  be  estimated  that  at  90°C,  10% 
of  the  units  will  fail  by  2200  hours  and  1 0%  will  remain  (90%  failed)  at  5000  hours. 

This  type  of  testing  is  not  limited  to  device  or  component  levels  of  assembly.  Circuit 
card  and  box  level  assemblies  can  be  tested  in  a  similar  manner.  Generally,  for  more 
complex  test  units,  the  probability  plot  will  be  developed  on  Weibull  p^r,  while  the 
relationship  plot  will  likely  require  a  trial  and  error  development  utilizing  several 
inverse  power  plots  to  find  an  adequate  fit. 
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(sjnoH)  eiuji  Oumuny 


Figure  T15-1:  Lognormal  Plot 
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(Oo)  ejniBj9diu8i 

Figure  T15-2:  Arrhenius  Plot 
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Topic  T16:  Time  Stress  Measurement 

Environmental  factors,  such  as  temperature,  humidity,  vibration,  shock,  power 
quality,  and  corrosion  impact  the  useful  lifetime  of  electronic  equipment.  Knowing 
the  environmental  conditions  under  which  the  equipment  is  operated  provides 
insight  into  equipment  faiiure  mechanisms.  The  capabiiity  to  measure 
environmental  parameters  will  help  reduce  and  control  the  incidence  of  Retest  OK 
(RTOK)  and  Cannot  Duplicate  (CNO)  maintenance  events  which  account  for  35%  to 
65%  of  the  indicated  faults  in  Air  Force  avionics  systems.  Many  of  these  RTOK  and 
CND  events  are  environmentaliy  related  and  a  record  of  the  environmental 
conditions  at  the  time  of  occurrence  should  greatly  aid  in  the  resoiution  of  these 
events. 

Active  Time  Stress  Measurement  Devices  (TSMD) 

•  Module  TSMD:  The  module  developed  by  the  Rome  Laboratory  is 
physically  6’  x  4’  x  1 .25"  and  measures  and  records  temperature,  vibration, 
humidity,  shock,  corrosion  and  power  transients.  This  module  operates 
independently  of  the  host  equipment  and  records  and  stores  data  for  later 
retrieval. 

•  Micro  TSMD:  The  micro  version  of  the  TSMD  is  a  smaii  hybrid  circuit  that  is 
suitabie  for  mounting  on  a  circuit  card  in  a  Line  Replaceabie  Unit  (LRU).  Ail 
the  parameters  measured  by  the  module  TSMD  are  recorded  in  the  micro 
version. 

•  Fault  Logging  TSMD:  A  new  advanced  device  has  been  deveioped  that 
is  suitable  for  circuit  board  mounting  and  inckjdes  environmentai  parameters 
being  measured  prior  to,  during,  and  after  a  Built-in-Test  (BiT)  detected  fault 
or  event.  The  environment  data  will  be  used  to  correlate  faults  with 
environmental  conditions  such  as  temperature,  vibration,  shock,  cooling  air 
supply  pressure,  and  power  supi^iy  conidition  to  better  determine  what  impact 
environment  has  on  system  failure. 

•  Quick  Reliability  Assessment  Tool  (QRAT):  The  objective  of  the 
effort  is  to  build  a  stand-alone,  compact,  portable,  easily  attachable  system  for 
quick  reaction  measurement  and  recording  of  environmental  stresses.  The 
parameters  it  measures  include  voltage,  temperature,  vibration  and  shock. 
The  system  which  includes  a  debrief  laptop  computer,  an  electronics  module 
with  internal  sensors,  a  battery  pack,  remote  sensors,  various  attachment 
plates,  and  will  fit  in  a  ruggedized  suitcase.  The  electronics  module  is  be  3”  x 
2"  X  0.5’  and  contains  the  sensors,  digital  signal  processor,  and  51 2K  bytes 
of  EEPROM  for  storage  of  data.  Three  axis  continuous  vibration  data  will  be 
recorded  and  stored  in  a  power  spectral  density  format.  The  user  could 
choose  to  use  either  the  sensors  internal  to  the  electronics  module  or  the 
remote  sensors  The  debrief  computer  is  used  to  tailor  the  electronics 
module  to  the  specific  needs  of  the  user  and  to  graphically  display  the 
collected  data.  Some  potential  uses  for  the  collected  data  are:  identification 
of  environmental  design  envelopes,  determination  of  loads  and  boundary 
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conditions  for  input  into  simulation  techniques,  and  characterization  of 
failures  in  specific  systems. 

Passive  Environmental  Recorders 

•  High  and  Low  Temperature  Strip  Recorders:  Strip  recorders  offer  a 
sequence  of  chemical  mixtures  deposited  as  small  spots  on  a  paper.  Each 
spot  changes  color  at  a  predetermined  temperature  showing  that  a  given 
value  has  been  exceeded. 

•  Temperature  Markers:  Maikers  are  available  to  measure  temperature 
extremes.  The  marking  material  either  melts  or  changes  color  at 
predetermined  temperatures. 

•  Humidity  Strip  Recorders:  Using  crystals  that  dissolve  at  different 
humidity  levels,  a  strip  recorder  is  available  that  indicates  if  a  humidity  level  has 
been  surpassed. 

•  Shock  Indicators:  Single  value  indicators  that  tell  when  an  impact 
acceleration  exceeds  the  set  point  along  a  single  axis. 

Application,  Active  Devices 

•  Avionic  Environmental  Stress  Recording 

•  Transportation  Stress  Recording 

•  Flight  Development  Testing 

•  Warranty  Verification 

•  Aircraft:  A-1 0,  A-7,  B-1 ,  and  EF-1 1 1 

For  More  Information: 

For  more  information  on  the  active  TSMD  devices  under  development  at  Rome 

Laboratory,  write: 

Rome  Laboratory/ERS 
Attn:  TSMD 
525  Brooks  Rd. 

Griffiss  AFB,  NY  13441-4505 
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Because  field  operation  introduces  factors  which  are  uncontrollable  by  contractors 
(e.g.  maintenance  policy),  "contract*  reliability  is  not  the  same  as  "operational" 
reliability.  For  that  reason,  it  is  often  necessary  to  convert,  or  translate,  from 
"contract"  to  "operational*  terms  and  vice  versa.  This  appendix  is  based  on  FtADC- 
TR-89-299  (Vol  I  &  II),  "Reliability  and  Maintainability  Operational  Parameter 
Translation  H"  which  developed  models  for  the  two  nwst  common  environments, 
ground  and  airborne.  The  translation  models  are  summarized  in  Table  1-1 . 

Definitions 


•  Mean-Time-Between-Failure-Field  (MTBFp)  includes  inherent  maintenance 
events  which  are  caused  by  design  or  manufacturing  defects. 

_  Total  Operating  Hours  or  Flight  Hours 
^  “  Inherent  Maintenance  Events 

•  Mean-Time-Between-Maintenance-Field  (MTBMp)  consists  of  inherent, 
induced  and  no  defect  found  maintenance  actions. 


MTBMf  = 


Total  Operating  Hours  or  Flight  Hours 
Total  Maintenance  Events 


•  Mean-Time-Between  Removals-Field  (MTBRp)  includes  all  removals  of  the 
equipment  from  the  system. 


MTBRf  = 


Total  Operating  Hours  or  Flight  Hours 
Total  Equipment  Removals 


0p 

Rf 

c 

D 


is  the  predicted  MTBF  (i.e.  MIL-HDBK-217). 

is  the  demonstrated  MTBF  (i.e.  MIL-HDBK-781). 
is  the  equipment  type  or  application  constant, 
is  the  power  on-off  cycles  per  mission, 
is  the  mission  duration. 


Equipment  Operating  Hour  to  Flight  Hour  Conversion 

For  Airborne  Categories  -  MTBFp  represents  the  Mean-Time-Between-Failure  in 
Equipment  Operating  Hours.  To  obtain  MTBFp  in  terms  of  flight  hours  (for  both 
fighter  and  transport  models),  divide  MTBFp  by  1.2  for  all  categories  except 
counter  measures.  Divide  by  .8  for  counter  measure  equipment. 


A 
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Example 

Estimate  the  MTBM  of  a  fighter  radar  given  a  mission  length  of  1 .5  hours,  two  radar 
shutdowns  per  mission  and  a  predicted  radar  MTBF  of  420  hours.  Using  Model  1 B 
in  Table  1-1, 

MTBFf  -  0p  ®^  Rp  (§)  =  (420  hr.)-64  i  .7  ( 

MTBFp  >  69  equipment  operating  hours  between  maintenance. 

Since  this  is  below  the  dependent  variable  lower  bound  of  (.24)(420)  =  101  hours, 
the  estimated  MTBMp  is  taken  to  be  101  equipment  operating  hours  between 
maintenance.  Since  this  equipment  is  often  turned  on  for  pre  and  post  flight 
checkout,  the  number  of  flight  hours  between  maintenance  is  somewhat  less  than 
the  actual  equipment  operating  hours.  The  number  of  flight  hours  between 
maintenance  is  approximately  101/1.2  =  84  hours. 
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Table  1-1 :  Reliability  Translation  Models 
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Exampl*  PMIabllity  Rwiulrwnefits  for  tiM  8yst»m  SpacHIcatlon 
R.1  Reliability  Requirements 

Guidance:  The  usa  of  the  latest  versions  and  notices  of  all  military  specifications, 
standards  and  handbooks  should  be  specified.  See  Toolkit  Section  R, 
"Requirements"  for  task  tailoring  guidance.  When  specifying  an  MTBF,  it  should  be 
the  "upper  test  MTBF  (Oq)  "  as  defined  in  MIL-STD-781.  When  specifying  MTBCF, 
the  maintenance  concept  needs  to  be  clearly  defined  for  purposes  of  calculating 
reliability  of  redundant  configurations  with  periodic  maintenance.  If  immediate 
maintenance  will  be  performed  upon  failure  of  a  redundant  element  then  specifying 
the  system  MTTR  is  sufficient.  If  maintenance  is  deferred  when  a  redundant 
element  fails,  then  the  length  of  this  deferral  period  should  be  specified. 

R.1.1  Mission  Reliability:  The  (system  name)  shall  achieve  a  mean-time- 

between-critical-failure  (MTBCF)  of  _  hours  under  the  worst  case 

environmental  conditions  specified  herein.  MTBCF  is  defined  as  the  total  uptime 
divided  by  the  number  of  critical  failures  that  degrade  full  mission  capability  (FMC). 
FMC  is  that  level  of  performance  which  ailows  the  system  to  perform  its  primary 
mission  without  degradation  below  minimum  levels  stated  herein.  For  purposes  of 
analyzing  redundant  configurations,  calculation  of  MTBCF  shall  reflect  the 
expected  field  maintenance  concept. 

R.1 .2  Basic  Reliability:  The  (system  name)  shall  achieve  a  series  configuration 

mean-time-between-failure  (MTBF)  of  _  hours  under  the  worst  case 

environmental  conditions  specified  herein.  The  series  configuration  MTBF  is 
defined  as  the  total  system  uptime  divided  by  the  total  number  of  part  failures. 

R.1 .3  Reliability  Configuration:  The  reliability  requirements  apply  for  the 
delivered  configuration  of  the  system.  Should  differences  exist  between  this 
configuration  and  a  potential  production  configuration,  all  analyses  shall  address 
the  reliability  effects  of  the  differences. 

Guidance:  If  equipment  or  system  performance  criteria  are  not  stated  elsewhere 
in  the  statement  of  work  or  specification,  the  following  paragraph  must  be  included. 

R.1 .4  Reliability  Performance  Criteria:  The  minimum  performance  criteria  that 
shall  be  met  for  full  mission  capability  of  the  (system  name)  is  defined  as 

(specify  full  mission  capability). 

R.1 .5  Reliability  Design  Requirements:  Design  criteria  and  guidelines  shall  be 
developed  by  the  contractor  for  use  by  system  designers  as  a  means  of  achieving 
the  required  levels  of  reliability. 

Guidance:  For  more  critical  applications.  Level  II  or  I.  derating  should  be  specified. 
See  Topic  D1  for  derating  level  determination.  Baseiine  thermal  r^uirements  such 
as  ambient  and  extreme  temperatures,  pressure  extremes,  mission  profile  and 
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duration,  temperature/pressure  rates  of  change  and  maximum  allowable 
temperature  rise  should  be  specified. 

R.1.5.1  Thermal  Management  and  Derating:  Thermal  management  (design, 
analysis  and  verification)  shall  be  performed  by  the  contractor  such  that  the 
reliability  quantitative  requirements  are  assured.  RADC-TR-82-172,  *RADC 
Thermal  Guide  for  Reliability  Engineers,”  shall  be  used  as  a  guide.  Derating  criteria 
shall  be  established  for  each  design  such  that  all  parts  used  in  the  system  are 
derated  to  achieve  reliability  requirements.  As  a  minimum.  Level  3  of  AFSC 
Pamphlet  800-27  'Part  Derating  Guidelines”  shall  be  used  for  this  design. 

Guidance:  If  the  system  is  for  airborne  use.  MIL-STD-5400  must  be  referenced  in 
place  of  MIL-E-4 158  (ground  equipment). 

R.1.S.2  Parts  Selection:  All  parts  employed  in  the  manufacture  of  the  system 
shall  be  selected  from  the  government  generated  and  maintained  Program  Parts 
Selection  List  (PPSL),  ElectricaiyElectronic  Parts  and  the  PPSL  for  Mechanical 
Parts.  Parts  not  covered  by  the  above  referenced  PPSLs  shall  be  selected  in 
accordance  with  MIL-E-4158  and  MIL-STD-454  and  require  approval  by  the 
procuring  activity. 

a.  Microcircuits.  Military  standard  microcircuits  must  be  selected  in 

accordance  with  Requirement  64  of  MIL-STD-454.  All  non-JAN  devices  shall 
be  tested  in  accordance  with  the  Class  B  screening  requirements  of  MIL- 
STD-883,  Method  5004  and  5008,  as  applicable.  All  device  types  shall  be 
tested  to  the  quality  conformance  requirements  of  MIL-STD-883,  Method 
5005  and  5008  Class  B. 

b.  Semiconductors.  Military  standard  semiconductors  must  be  selected  in 
accordance  with  Requirement  30  of  MIL-STD-454.  All  non-JANTX  devices 
shall  be  screened  in  accordance  with  Table  II  of  MIL-S-19500.  All  device 
types  shall  be  tested  to  the  Group  A,  Table  III  and  Group  B,  Table  IV  quality 
conformance  requirements  of  MIL-S-19500,  as  a  minimum.  The  following 
device  restrictions  apply: 

(1 )  Only  solid  glass  metallurgically  bonded  axial  lead  diodes  and  rectifiers 
shall  be  used. 

(2)  TO-5  packages  shall  be  limited  to  the  solid  metal  header  type. 

(3)  All  semiconductor  device  junctions  must  be  protected  and  no  organic 
or  desiccant  materials  shall  be  included  in  the  package. 

(4)  Devices  using  aluminum  wire  shall  not  use  thermocompression  wedge 
bonding. 

(5)  Aluminum  TO-3  packages  shall  not  be  used. 

(6)  Germanium  devices  shall  not  be  used. 


A-10 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


EXAMPLE  R&M  REQUIREMENT  PARAGRAPHS 


c.  Electrostatic  Sensitive  Parts.  Certain  types  of  integrated  circuits  are 
susceptible  to  electrostatic  discharge  damage.  Appropriate  discharge 
procedures  are  necessary  when  handling,  storing  or  testing  these  parts  and 
design  selections  of  desired  devices  should  include  a  consideration  of  the 
effectiveness  of  the  input  or  other  protective  elements  included  in  the  device 
design. 

R.1.6  Reliability  Test  and  Evaluation:  The  quantitative  reliability  levels  required 
by  paragraph  (R.l)  shall  be  verified  by  the  following; 

R.1.6.1  The  final  approved  reliability  analyses  for  the  various  configurations  and 
worst  case  environments  shall  demonstrate  compliance  with  the  quantitative 
requirements  cited  in  paragraph  (R.l). 

R.l. 6.2  The  contractor  shall  demonstrate  that  the  reliability  (mission  and/or  basic) 
requirements  have  been  achieved  by  conducting  a  controlled  reliability  test  in 
accordance  with  MIL-HDBK-781  Test  Plan  (specify  MIL-HDBK-781  Test  Plan). 
(See  Topic  T5  and  Appendix  5  for  Plan  Selection).  The  lower  test  (MTBCF  and/or 

MTBF)  to  be  demonstrated  shall  be _ hours  tested  in  a _ environment. 

Relevant  failures  are  defined  as  any  malfunction  which  causes  loss  or  degradation 
below  the  performance  level  specified  for  the  (equipment/system)  and  can  be 
attributed  to  design  defect,  manufacturing  defect,  workmanship  defect,  adjustment, 
deterioration  or  unknown  causes.  Nonrelevant  failures  are  failures  caused  by 
installation  damage,  external  test  equipment  failures,  mishandling,  procedural 
errors,  dependent  failures  and  external  prime  power  failures. 

Guidance:  A  growth  test  may  apply  if  the  next  phase  is  production.  If  one  is 
required,  it's  appropriate  to  require  a  higher  risk  (e.g.,  30  percent)  demonstration 
test  See  RADC-TR-84-20  "Reliability  Growth  Testing  Effectiveness,"  Topic  T4  and 
Appendix  6  for  further  guidance. 

R.l  .6.3  The  contractor  shall  conduct  a  controlled  fixed  length  dedicated  reliability 

growth  test  of _ hours  using  MIL-HDBK-189  as  a  guide.  The  test  shall  be  at  the 

same  environmental  conditions  as  the  RQT.  Although  there  is  no  pass/fail  criteria, 
the  contractor  shall  track  the  reliability  growth  process  to  ensure  improvement  is 
taking  place  by  effective  implementation  of  corrective  action. 

Guidance:  See  Electronic  Systems  Center  Report  TR-85-148,  "Derated 
Application  of  Parts  for  ESC  Systems  Development"  (Attachment  2)  for  a 
recommended  derating  verification  procedure. 

R.l. 6.4  The  contractor  shall  verify  the  thermal  and  electrical  stresses  on _ 

percent  (3  to  5  percent  sample  is  typical)  of  the  semiconductor  and  microcircuit 
parts  by  measurement  while  the  equipment  is  operated  at  the  worst  case 
environment,  duty  cycle  and  load.  The  results  of  the  measurements  shall  be 
compared  to  the  derating  requirements  and  the  verification  shall  be  considered 
successful  if  measured  values  are  less  than  specified  derated  levels. 
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Emmpto  Mlablllty  RaquiranMcits  for  tho  Statoment  of  Work 
R.2  Reliability  Program  Tasks 

R.2.1  Reliability  Program:  The  contractor  shall  conduct  a  reliability  program  in 
accordance  with  MIL-STO-785  including  the  following  tasks  as  a  minimum  to 
assure  reliability  consistent  with  state-of-the-art. 

R.2.2  Subcontractor  Control:  The  contractor  shall  establish  management 
procedures  and  design  controls  including  allocation  of  requirements  in  accordance 
with  Task  102  of  MIL-STD-785  which  will  insure  that  products  obtained  from 
subcontractors  will  meet  reliability  requirements. 

R.2.3  Rellabllfty  Design  Reviews:  The  status  of  the  reliability  design  shall  be 
addressed  at  all  internal  and  external  design  reviews.  Task  103  of  MIL-STD-785 
shall  be  used  as  a  guide. 

R.2.4  Failure  Reporting,  Analysis  and  Corrective  Action  System  (FRACAS): 

The  contractor  shall  establish,  conduct  and  document  a  closed  loop  failure 
reporting,  analysis  and  corrective  action  system  for  all  failures  occurring  during 
system  debugging,  checkout,  engineering  tests  and  contractor  maintenance. 
Failure  reports  shall  be  retained  by  the  contractor  and  failure  summaries  provided 
to  the  procuring  activity  thirty  days  after  start  of  system  engineering  test  and 
evaluation,  and  updated  monthly  thereafter.  Failure  reporting  shall  be  to  the  piece 
part  level. 

R.2.5  Reliability  Modeling:  The  contractor  shall  develop  reliability  models  for  all 
system  configurations  in  accordance  with  Task  201  of  MIL-STO-785  and  Task  101 
and  201  of  MIL-STD-756.  The  specific  mission  parameters  and  operational 

constraints  that  must  be  considered  are: _ (or  reference  applicable  SOW  and 

specification  paragraphs). 

R.2.6  Reliability  Allocations:  Reliability  requirements  shall  be  allocated  to  the 
LRU  level  in  accordance  with  Task  202  of  MIL-STD-785. 

R.2.7  Reliability  Prediction:  The  contractor  shall  perform  reliability  predictions  in 
accordance  with  (Task  201  (basic  reliability))  and/or  (Task  202  (mission  reliability)) 
of  MIL-STD-756.  The  specific  technique  to  be  used  shall  be  method  2005  parts 
stress  analysis  of  MIL-STD-756.  Electronic  part  failure  rates  shall  be  used  from 
MIL-HDBK-217  and  nonelectronic  part  failure  rates  from  RADC-TR-85-194.  All 
other  sources  of  part  failure  rate  data  shall  require  review  and  approval  of  the 

procuring  activity  prior  to  use.  A _ environmental  factor,  worst  case  operating 

conditions  and  duty  cycles  shall  be  used  as  a  baseline  for  developing  part  failure 
rates.  The  results  of  the  thermal  analysis  shall  be  included  and  shall  provide  the 
temperature  basis  for  the  predicted  reliability.  The  part  quality  grade  adjustment 
factor  used  shall  be  representative  of  the  quality  of  the  parts  selected  and  applied 
for  this  system  procurement. 

R.2.8  Parts  Program:  The  contractor  shall  establish  and  maintain  a  parts  control 
program  in  accordance  with  Task  207  of  MIL-STD-785  and  Procedure  1  of  MIL- 
STD-965.  Requests  for  use  of  parts  not  on  the  government  generated  and 
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maintained  PPSL  shali  be  submitted  in  accordance  with  the  CDRL.  Amendments 
to  the  PPSL  as  a  result  of  such  requests,  after  procuring  activity  approval,  shall  be 
supplied  to  the  contractor  by  the  Program  Contracting  Officer  not  more  often  than 
once  every  30  days. 

Guldance:Th0  level  of  detail  of  the  FMECA  must  be  specified  (e.g.,  part,  circuit 
card,  etc.).  The  closer  the  program  is  to  full  scale  engineering  development,  the 
greater  the  level  of  detail  needed. 

R.2.9  Failure  Modes,  Effects  and  Criticality  Analysis  (FMECA):  The  contractor 

shall  perform  a  limited  FMECA  to  the _ level  to  identify  design  weaknesses  and 

deficiencies.  Potential  failure  modes  shall  be  identified  and  evaluated  to  determine 
their  effects  on  mission  success.  Critical  failures  shall  be  investigated  to  determine 
possible  design  improvements  and  elimination  means.  MIL-STO-785,  Task  204 
shall  be  used  as  a  guide. 

Guidance:  Reliability  critical  Herns  should  be  required  where  it's  anticipated  that 
the  design  will  make  use  of  custom  VLSI,  hybrids,  microwave  hybrids  and  other 
high  technology  nonstandard  devices.  See  Topic  D5  fora  critical  item  checklist. 

R.2.10  Reliability  Critical  Items:  Task  number  208  of  MIL-STD-785  applies.  The 
contractor  shall  prepare  a  list  of  critical  items  and  present  this  list  at  all  formal 
reviews.  Critical  items  shall  include:  Herns  having  limited  operating  life  or  shelf  life. 
Hems  difficun  to  procure  or  manufacture.  Hems  with  unsatisfactory  operating  history, 
items  of  new  technology  with  little  reliability  data,  single  source  Hems,  parts 
exceeding  derating  limHs,  and  Hems  causing  single  points  of  failure. 

R.2.11  Effects  of  Storage,  Handling,  Transportation:  The  contractor  shali 
analyze  the  effects  of  storage,  handling  and  transportation  on  the  system  reliability. 

R.2.12  Reliability  Qualification  Test:  The  contractor  shall  demonstrate 
compliance  with  the  quantHative  reliability  requirements  in  accordance  wHh  MIL- 
STD-785  Task  302.  Test  plans  and  reports  shall  be  developed  and  submitted. 

R.2.13  Reliability  Oevelopment/Growth  Test:  Test  plans  that  show  data  tracking 
growth,  testing  rriethods  and  data  collection  procedures  shall  be  developed  and 
submHted  for  the  Growth  Test  Program. 

Guidance:  When  specifying  ESS,  the  level  (circuit  card,  morale,  assembly,  etc.) 
at  which  the  screening  is  to  be  performed  must  be  specified.  Different  levels  of 
screening  should  be  performed  at  different  hardware  assembly  levels.  See  R&M 
2000  guidelines  in  Section  T  for  recommended  screening  as  a  function  of  hardware 
assembly  level. 

R.2.14  Environmental  Stress  Screening:  Task  number  301  of  MIL-STD-785 

applies.  A  bum-in  test  of _ (specify  the  number  of  hours  or  temperature  cycles) 

at _ temperature  and _ vibration  level  extremes  shall  be  performed  at  the 

_  level.  At  least _  (hours/cycles)  of  failure  free  operation  shall  be 

experienced  before  termination  of  the  bum-in  test  for  each  unH.  DOD-HDBK-344, 
ESS  of  Electronic  Equipment,  shall  be  used  as  a  guide. 
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Exampl*  IliiiitalMbllity  Rcquiraments  for  tho  Systom 
SpocMcation 

M.1  Maintainability  Requirements 

M.1.1  Maintainability  Quantitative  Requirements:  The  (system  name)  shall  be 
designed  to  achieve  a  mean-corrective-maintenance-tinf)e  (Mqt)  of  no  greater  than 

_ minutes  and  a  maximum-corrective  maintenance-time  (Mmaxct)  of  no 

greater  than _  minutes  (95th  percentile)  at  the  (specify  organization, 

intermediate  or  depot  level),  when  repaired  by  an  Air  Force  maintenance  technician 
of  skill  level _ or  equivalent. 

Guidance:  Preventive  maintenance  r^uirements  are  considered  an  option  to  be 
implemented  when  items  are  used  in  the  design  that  are  subject  to  wearout, 
alignment,  adjustment  or  have  fault  tolerance  that  must  be  renewed.  If  the  option  is 
exercised,  then  attach  the  paragraph  below  to  M.  1. 1. 

M.1. 2  Preventive  maintenance  shall  rwt  exceed _ minutes  for  each  period  and 

the  period  shall  not  be  more  frequent  than  every _ . 

M.1 .3  The  mean  time  to  restore  system  (MTTRS)  following  a  system  failure  shall 

not  be  greater  than _ .  MTTRS  includes  all  corrective  maintenance  time  and 

logistics  delay  lime. 

M.1 .4  The  mean  maintenance  manhours  (M-MMH)  shall  not  be  greater  than _ 

hours  per  year.  M-MMH  is  defined  as  follows;  (operating  hours  per  year)  +  (system 
MTBF)  (system  MTTR)  (number  of  maintenance  personnel  required  for  corrective 
action). 

Guidance  Above  definition  of  M-MMH  assumes  that  a  repair  is  made  when  each 
failure  occurs.  If  a  delayed  maintenance  concept  is  anticipated  through  the  use  of 
fault  tolerance,  then  MTBCF  should  be  used  (instead  of  MTBF)  in  the  above 
definition,  if  only  a  limited  number  of  site  visits  are  allowed,  then  this  value  should 
be  used  in  the  above  definition  in  place  of  "operating  hours  per  year  system 
MTBF." 

M.1. 5  Maintainability  Design:  The  system  design  shall  provide  modularity, 
accessibility,  built-in-test  (BIT)  and  other  maintainability  features  to  provide 
installation  simplicity,  ease  of  maintenance  and  the  attainment  of  the  maintainability 
requirements  (both  corrective  and  preventive).  Line  Replaceable  Units  (LRUs)  such 
as  printed  circuit  boards  or  assemblies  shall  be  replaceable  without  cutting  or 
unsoldering  connections.  All  plug-in  nfxxfules  shall  be  mechanically  keyed/coded  to 
prevent  insertion  of  a  wrong  module. 
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M.1.5.1  Testability:  The  system  design  shall  be  partitioned  based  upon  the  ability 
to  isolate  faults.  Each  item  shall  have  sufficient  test  points  for  the  measurement  or 
stimulus  of  internal  circuit  nodes  to  achieve  the  cap^ility  of  detecting  100  percent 
of  all  permanent  failures  using  full  resources.  Automatic  rrxinitoring  and  diagnostic 
capabilities  shall  be  provided  to  show  the  system  status  (operable,  inoperable, 
degraded)  and  to  detect  90  percent  of  all  permanent  failures.  The  false  alarm  rate 
due  to  self-test  circuitry  shall  be  less  than  1  percent  of  the  series  failure  rate.  Self¬ 
test  circuitry  shall  be  designed  to  correctly  isolate  the  fault  to  a  group  of  four  (4) 
LRUs,  or  less,  95  percent  of  the  time. 

M.1.6  Maintainability  Test  and  Evaluation:  Maintainability  requirements  for  the 
(system  name)  shall  be  verified  by  the  following; 

M.1.6.1  Maintainability  Analysis.  The  results  of  the  final  maintainability  prediction 
shall  be  compared  to  the  quantitative  requirements  and  achievement  determined  if 
the  predicted  parameters  are  less  than  or  equal  to  the  required  parameters. 

M.1.6.2  Maintainability  Demonstration.  A  maintainability  demonstration  shall  be 

performed  in  accordance  with  Test  Method _ (Test  Method  9  is  commonly 

specified,  see  Appendix  7  for  further  guidance)  of  MIL-STD-471.  A  minimum 
sample  size  of  50  tasks  shall  be  demonstrated.  The  consumer's  risk  for  the 
maintainability  demonstration  shall  be  equal  to  10  percent.  Fault  detection  and 
isolation  requirements  shall  be  demonstrated  as  part  of  the  maintainability  test. 

M.1.6.3  Testability  Demonstration.  A  testability  demonstration  shall  be  performed 
on  the  (system  name)  in  accordance  with  Notice  2  of  MIL-STD-471  A. 
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Exanwto  Maintalnabittty  R«qulreimnts  for  the  Statement  of  Work 
M.2  Maintainability  Program  Tasks 

M.2.1  Maintainability  Program:  The  contractor  shall  conduct  a  maintainability 
program  in  accordance  with  MIL-STD-470  appropriately  tailored  'or  full  scale 
development  including  the  following  tasks  as  a  minimum  to  assure  maintainability 
consistent  with  the  requirements. 

MJ2.2  Testability  Program:  Testability  characteristics  and  parameters  are  related 
to,  and  shall  be  treated  as  part  of  the  maintainability  program.  The  contractor  shall 
conduct  a  testability  program  in  accordance  with  MIL-STD-2165  appropriately 
tailored  for  PSD  including  the  following  tasks  as  a  minimum  to  assure  testability 
consistent  with  the  requirements. 

M.2.3  Maintainability  Design  Rev'ew:  The  status  of  the  maintainability/ 
testability  design  shall  be  addressed  at  ati  internal  and  external  design  reviews. 

M.2.4  Subcontractor  Control:  The  contractor  sl'  .ll  specify  maintainability 
requirements  to  all  subcontractors  to  insure  that  (equipment/system  name) 
requirements  of  this  program  are  attained.  Task  102  of  MIL-STD-470  shall  be  used 
as  a  guide. 

M.2.5  Maintainability/Testability  Modeling:  The  contractor  shall  establish  a 
maintainability  model  using  MIL-STD-470,  Task  201  which  reflects  the  construction 
and  configuration  of  the  PSD  design.  Linkages  with  MIL-STD-2165,  Task  201  to 
relate  testability/diagnostic  design  characteristics  to  maintainability  parameters 
shall  be  provided. 

M.2.6  Maintainability  Prediction:  The  contractor  shall  predict  maintainability 
figures  of  merit  using  Procedure  V  of  MIL-HDBK-472  (Notice  1)  at  the  on 
equipment  level.  MIL-STD-470,  Task  203  shall  be  used  as  a  guide. 

M.2.7  Maintalnability/Testabllity  Design  Criteria:  The  contractor  shall  develop 
design  criteria  to  be  used  in  the  design  process  to  achieve  the  specified 
maintainability  and  testability  requirements.  In  addition,  a  design  analysis  showing 
failure  modes,  failure  rates,  ease  of  access,  modularity  and  the  capability  to 
achieve  the  fault  detection/isolation  requirement  shall  be  provided.  RADC-TR-74- 
308  "Maintainability  Engineering  Design  Handbook,"  RADC-TR-82-189  "RADC 
Testability  Notebook,"  Task  202  of  MIL-STD-2165  and  Task  206  of  MIL-STD-470A 
shall  be  used  as  a  guide. 

Guidance:  Mair.iainability  demonstration  reports  are  only  necessary  if  a 
maintainability  test  is  specified  in  the  maintainability  specification  requirements. 

M.2.8  Maintainablllty/Testablilty  Demonstration:  A  test  plan  and  test  report 
shall  be  submitted  by  the  contractor.  Task  301  of  MIL-STD-470  and  Task  301  of 
MIL-STD-2165  shall  be  used  cS  guides. 
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Several  hundred  R&M  software  tools  exist  throughout  Government,  industry  and 
academia.  Table  3-1  lists  software  tool  types  with  associated  supplier  reference 
numbers.  The  numbered  list  of  suppliers  follows.  The  list  includes  addresses  and 
telephone  numbers  confirmed  to  be  accurate  as  of  Aug  92.  The  Rome  Laboratory 
doesnl  in  any  way  endorse  or  encourage  use  of  any  specific  supplier's  tools  listed. 
Potential  software  tool  users  should  thoroughly  research  any  claims  made  by 
software  suppliers  and  carefully  study  their  own  needs  before  obtaining  any 
software.  Further  information  on  R&M  software  tools  can  be  obtained  in  the  reports 
referenced  below.  The  reports  contain  data  relative  to  software  tool's  hardware 
requirements,  claimed  capabilities,  interface  capabilities,  demonstration  package 
availability  and  price. 

R&M  Software  Tool  References 

RL-TR-91-87  "A  Survey  of  Reliability,  Maintainability,  Supportability  and 
Testability  Software  Tools" 

RMST  91  "R&M  Software  Tools,"  Reliability  Analysis  Center 


Table  3-1 :  Software  Tool  Type/Supplier  Reference 
Number  Listing 


Software  Tool  Type 

Supplier  Reference  Numbers 

1. 

la. 

Reliability  Prediction 

Component  Prediction  Tools  (e.g.  MIL-HDBK- 
21 7,  Bellcore,  etc.) 

1 ,5,9,1 0,1 5,1 6,1 7,1 9,20,21 .27, 
28,32,34,  36,38,39 

1b. 

System  Modeling  (e.g.  Markov,  Monte  Carlo, 
Availability) 

1.5,6.17.19,20.22.32,33.35,36 

1c. 

Mechanical  Component  Data 

15,27,31 

2. 

Failure  Mode  and  Effects  Analysis  (FMEA) 

1,5,19,20,21,27 

3. 

Fault  Tree  Analysis 

1.5,14,16.17,18,21.22,32.33 

4. 

Reliability  Testing 

(e.g.  MIL-HDBK-781.  ESS,  etc.) 

13,16,18,25,32 

5. 

Reliability  Management 

32,35 

6. 

Maintainability  Prediction 

5.10,17.19.21,27.32 

7. 

Testability  Analysis 

2,3,4,5,19,21,23,24,30,32 

8. 

Thermal  Analysis 

26,32,38 

9. 

Finite  Element  Analysis 

8,26,32,37 

10. 

Statistical  Analysis  (e.g.  Weibuil) 

11,12,16.25.29,40.41 

11. 

Sneak  Circuit  Analysis 

32,35 

12. 

Design  of  Experiments 

25 

13. 

Logistics 

1,5,17,20,21,38 
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R&M  Software  Tool  Supplier  Listing 


1. 

Advanced  Logistics  Developments 

11. 

Fulton  Findings 

PO  Box  232 

1251  W.  Sepulveda  Blvd  #800 

College  Point  NY  11356 

Torrance  CA  90502 

(718)463-6939 

(310)548-6358 

2. 

ARINC  Research  Corp 

12. 

G.R.  Technologies  (Pister  Grp) 

2551  Riva  Road 

PO  Box  38042 

Annapolis  MO  21401 
(301)266-4650 

550  Eglinton  Ave,  West 

Toronto  Ontario,  M5N  3A8 

(416)886-9470 

3. 

Automated  Technology  Systems  Corp 
25  Davids  Drive 

Hauppauge  NY  1 1 788 
(516)231-7777 

13. 

H&H  Servioco 

PO  Box  9340 

North  St.  Paul  MN  55109 
(612)777-0152 

4. 

CINA,  Inc. 

PO  Box  4872 

14. 

Idaho  National  Engineering  Lab 

Mountain  View  CA  94040 

EG&G  Idaho,  Inc. 

(415)940-1723 

Idaho  Falls  ID  83415 
(208)526-9592 

5. 

COSMIC 

382  East  Broad  St 

15. 

Innovative  Software  Designs,  Inc. 

Athens  GA  30602 

Two  English  Elm  Court 

(404)542-3265 

Baltimore  MD  21228 
(410)788-9000 

6. 

Decision  Systems  Assoc 

746  Crom^Xon 

16. 

Innovative  Timely  Solutions 

Redwood  City  CA  94061 

6401  Lakerest  Court 

(415)369-0501 

Raleigh  NC  27612 
(919)846-7705 

7. 

DETEX  Systems,  Inc. 

1574  N.  Batavia,  Suite  4 

Orange  CA  92667 
(714)637-9325 

17. 

Hern  Software  Ltd 

3031  E.  LaJolla  St 

Anaheim  CA  92806 
(714)666-8000 

8. 

Engineering  Mechanics  Research  Corp 
PO  Box  696 

18. 

JBF  Associates 

Troy  Ml  48099 

1000  Technology  Park  Ctr 

(313)689-0077 

Knoxville  TN  37932 
(615)966-5232 

9. 

Evaluation  Associates  Inc. 

GSB  Building,  1  Belmont  Ave 

Bala  Cynwyd  PA  19004 
(215)667-3761 

19. 

JORI  Corp 

461 9  Fontana  St 

Orlando  FL  32807 
(407)658-8337 

10. 

Evaluation  Software 

2310  Claassen  Ranch  Lane 

20. 

Logistic  Engineering  Assoc 

Paso  Robies  CA  93446 

2700  Navajo  Rd,  Suite  A 

(805)239-4516 

El  Cajon  CA  92020 
(619)697-1238 
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21 .  Management  Sciences  Inc. 

6022  Constitution  Ave,  N.E. 
Abuquerque  NM  87110 
(505)255-861 1 

22.  Energy  Science  &  Technology 
Software  Ctr 

POBox  1020 

Oak  Ridge  TN  37831 

(615)576-2606 

23.  Naval  Air  Warefare  Ctr/AD,  ATE 
Software  Center 

Code  PD22 
Lakehurst  NJ  08733 
(908)323-2414 

24.  NAVSEA 
Code  04  D52 
Washington  DC  20362 
(703)602-2765 

25.  Nutek,  Inc. 

30400  Telegraph  Rd,  Suite  #380 
Birmingham  Ml  48010 
(313)642-4560 

26.  Pacific  Numerix  Corporation 
1 200  Prospect  St,  Suite  300 
La  Jolla  GA  92037 
(619)587-0500 

27.  Powertronic  Systems,  Inc. 

13700  Chef  Mentour  Hwy 
New  Orleans  LA  701 29 
(504)254-0383 

28.  Prompt  Software  Co 
393  Englerl  Court 
San  Jose  CA  95133 
(408)258-8800 

29.  Pritsker  Corporation 
8910  Perdue  Rd,  Suite  500 
Indianapolis  IN  46286 
(317)879-1011 

30.  RACAL-REDAC 
1000  Wyckoff  Ave 
Mahwah  NJ  07430 
(201)848-8000 


31 .  Reliability  Analysis  Center  (RAC) 
PO  Box  4700, 201  Mill  St 
Romo  NY  13440 
(315)337-0900 

32.  Rome  Laboratory/ERS 
525  Brooks  Rd 

Griffiss  APB  NY  13441-4505 
(315)330^205 

33.  SAIC 

5150  El  Camino  Real,  Suite  C-31 
Los  Altos  CA  94022 
(415)960-5946 

34.  Sendrian  Resources  Corp  (SRC) 
42  San  Lucas  Ave 

Newbury  Lake  CA  91320 
(805)499-7991 

35.  SoHaR  Incorporated 

8421  Wilshire  Blvd,  Suite  201 
Beverly  Hills  CA  9021 1 
(213)653-4717 

36.  Spentech  Company 
2627  Greyling  Drive 
San  Diego  CA  92123 
(619)268-3742 

37.  Swanson  Analysis  Systems  Inc. 
Johnson  Rd,  PO  Box  65 
Houston  PA  15342 
(412)746-3304 

38.  Systems  Effectiveness  Assoc 
20  Vernon  Street 
Norwood  MA  02062 
(617)762-9252 

39.  T-Cubed  Systems,  Inc. 

31220  La  Baya  Dr,  Suite  110 
Westlake  Village  CA  91362 
(818)991-0057 

40.  Team  Graph  Papers 
Box  25 

Tamworih  NH  03886 
(603)323-8843 

41.  Teque,  Inc. 

11686  N.  Daniels  Dr. 
Germantown  Wl  53022 
(414)255-7210 
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This  Appendix  contains  an  exampie  set  of  design  guidelines  structured  to  include 
verification  methods.  These  guidelines  are  an  example  only  and  doni  apply  to  all 
situations. 

a.  Thermal  Design 

(1)  Integrated  Circuit  Junction  Temperatures 

Design  Guidelines:  The  design  of  the  environmental  cooling  system  (ECS) 
should  be  capable  of  maintaining  an  average  integrated  circuit  junction  temperature 
of  55*^  or  less  under  typical  operating  conditions.  Under  virorst  case  steady  state 
conditions,  components  should  operate  at  least  50°C  below  their  rated  maximum 
junction  temperature. 

Analysis  Recommendation:  Thermal  finite  element  analysis  should  be 
performed  to  project  operating  temperatures  under  specified  environmental 
conditions.  The  analysis  should  consider  ECS  performance,  environmental 
impacts,  and  system  thermal  design.  Average  junction  temperatures  should 
include  all  integrated  circuits  within  the  system.  Average  temperature  rise  should 
include  all  components  on  an  individual  module. 

Test  Recommendations:  Thermally  instrumented  observations  should  be 
made  of  components  under  specified  environmental  conditions.  Instrumentation 
can  be  by  direct  contact  measurement  or  by  infrared  photography. 

(2)  Thermal  Gradients 

Design  Guideline:  The  maximum  allowable  temperature  rise  from  any  junction  to 
the  nearest  heat  sink  should  be  25°C.  The  average  temperature  rise  from 
integrated  circuit  junctions  to  the  heat  sink  should  be  no  greater  than  tS^C.  To 
minimize  gradients,  more  complex  and  power-intensive  devices  should  be  placed 
to  minimize  their  operating  temperature. 

Analysis  Recommendation:  Automated  design  tools  that  perform  component 
placement  should  be  programmed  to  produce  this  result.  A  thermal  finite  element 
analysis  should  be  used  to  evaluate  the  projected  thermal  gradient  under  the 
specified  environmental  conditions. 

Test  Recommendation:  Thermally  instrumented  observation  of  components 
under  specified  environmental  conditions.  Instrumentation  can  be  by  direct  contact 
measurement  or  by  infrared  photography. 

(3)  Thermal  Expansion  Characteristics 

Design  Guideline:  Component  and  board  materials  should  be  selected  with 
compatible  thermal  coefficients  of  expansion  (TCE).  Additionally,  coldplate 
materials  should  be  selected  for  TCE  compatibility  with  the  attached  printed  wiring 
board.  TCE  mismatch  results  in  warpage  of  the  laminated  assembly,  which  can 
reduce  module  clearances  and  stress  circuit  board  component  leads  and  solder 
joints. 
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Analysis  Rscommendation;  A  finite  element  analysis  should  be  performed  to 
identify  the  stress  patterns  in  the  solder  joints  attaching  the  components  to  the 
board.  TCE  compatibility  should  be  evaluated  for  the  components,  circuit  board, 
and  cokjplate. 

Test  Recommendation:  Environmental  stress  tests  should  be  utilized  in  the 
development  phase  to  verify  the  design  analysis  and  environmental  stress 
screening  should  be  used  in  production  to  ensure  consistency  throughout  the 
production  cycle. 

(4)  Heat  Transport  Media 

Design  Guideline:  The  design  should  use  a  thermal  conduction  medium  that  is 
integral  to  the  mechanical  design  of  the  board  or  module.  Heat  pipes,  metal  rails  or 
internal  planes  are  examples  of  thermally  conductive  media.  The  unit  should  meet 
temperature  design  requirements  by  cooling  through  the  integral  thermal 
conduction  medium  without  depending  on  any  other  heat  loss. 

Analysis  Recommendation:  Thermal  finite  element  analysis  should  be  used  to 
project  heat  flow  under  specified  environmental  conditions.  Modules  employing 
heat  pipes  for  cooling  should  meet  operating  temperature  requirements  when  the 
module  heat  sink  is  inclined  at  an  angle  of  90  degrees  from  the  horizontal. 

Test  Recommendation:  Thermally  instaimented  observation  should  be  made 
of  components  under  specified  environmental  conditions.  Instrumentation  can  be 
by  direct  contact  measurement  or  by  infrared  piiotography. 

(5)  Component  Attachment 

Design  Guideline:  Surface  contact  should  be  maximized  between  the 
component  and  the  heat  transport  media.  This  can  be  achieved  by  direct  pressure 
thermal  compounds  or  solder.  The  technique  used  should  be  reversible  for 
con^nent  removal  during  board  repairs  such  that  damage  is  not  induced  to  nearby 
devices.  If  a  thermal  compound  is  used,  it  should  not  migrate  or  react  with  other 
components  during  testing  or  service  use. 

Analysis  Recommendation:  Specialized  stress  analyses  should  be  performed 
to  quantify  thermal  and  mechanical  stresses  involved  in  removing  the  component 
from  the  board  after  production  installation. 

Test  Recommendation:  Demonstration  of  repair  techniques  should  be 
performed  early  in  the  development  phase. 

(6)  Thermal  Cycling 

Design  Guideline:  The  unit  ".hould  be  designed  to  dampen  its  thermal 
response  to  the  thermal  excursions  required  by  the  specification.  This  can  be 
achieved  by  using  a  large  thermal  mass  or  by  using  the  cooling  medium  to  insulate 
the  unit  from  its  environment  to  the  maximum  extent  possible. 
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Analysis  Rscommendatlon:  Thermal  finite  element  analysis  to  project  heat 
flow  and  temperature  excursions  under  specified  environmental  conditions. 

Test  Recommendation:  Thermally  instrumented  observation  of  components 
under  specified  environmental  excursions.  Instmmentation  can  be  by  direct 
contact  measurement  or  by  infrared  photography. 

b.  Testability  Design 

(1)  Bottom-up  Fault  Reporting 

Design  Guideline:  Incorporate  autononraus  self-testing  at  the  lowest  levels  that 
are  technically  feasible.  Utilize  positive  indication  to  report  chip,  module  and 
subsystem  status.  The  design  should  not  depend  upon  external  stimuli  to  perform 
fault  detection  or  isolation  to  a  replaceable  element. 

Analysis  Recommendation:  As  soon  as  automated  testability  analysis  toots 
become  available,  they  should  be  used  for  the  applicable  engineering  design 
workstations. 

Test  Recommendation:  Hardware  derrnnstration  should  be  conducted  early  in 
the  development  phase  to  verify  simulation  results  through  the  insertion  of  faults 
using  the  currently  available  version  of  the  operational  program,  firmware  and 
microcode. 

(2)  Fault  Logging 

Design  Guideline:  Modules  should  contain  a  non-volatile  fault  log  that  can  be 
accessed  by  a  system  maintenance  controller  or  by  test  equipment.  The  use  of  the 
fault  log  will  improve  reliability  by  reducing  depot  ’Cannot  Duplicates.”  Failure  of  the 
fault  log  should  not  cause  a  critical  system  failure,  but  should  be  obsenrable  to  the 
maintenance  controller. 

Analysis  Recommendation:  Compliance  should  be  verified  by  inspection. 
Operation  should  be  verified  by  simulation. 

Test  Recommendation:  Not  applicable. 

(3)  Start-up  Bullt-ln-Test  (BIT) 

Design  Guideline:  The  module  should  execute  a  BIT  internal  diagnostic  routine 
immediately  after  power-up  or  receipt  of  an  ’Execute  BIT’  command.  BIT  should 
provide  a  complete  functional  test  of  the  module  to  the  maximum  extent  possible 
without  transmitting  any  signals  on  external  interface  media.  BIT  should  provide  a 
complete  functional  test  of  the  module  and  should  include: 

(1 )  Verification  of  internal  data  paths 

(2)  Verify  statton  physical  address 
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(3)  Verify  message  identification  process  from  system 

(4)  Verify  proper  functioning  of  aii  internal  memory  and  other  conr^nents 

Any  failure  encountered  during  execution  of  BIT  should  be  retried  at  lease  once  to 
confirm  the  response.  Any  confirmed  failures  should  prevent  the  module  from 
becoming  enabled.  A  failed  module  should  respond  only  to  ’RESET,”  ’Execute 
BIT,’  and  ’Report  Status’  commands. 

Analysis  Recommendation:  System  design  simulation  tools  should  be  used 
to  verify  operation  of  the  BIT.  These  tools  should  include  fault  simulations  as  well  as 
operational  simulation. 

Test  Recommendation:  Hardware  demonstration  should  be  conducted  early 
in  the  development  phase  to  verify  simulation  results  through  insertion  of  faults 
using  currently  available  versions  of  the  operational  program,  firmware  and 
microcode. 

(4)  Background  Diagnostics 

Design  Guideline:  During  normal  operation,  the  rTK>dule  should  continuously 
monitor  itself  through  a  background  diagnostic  test.  The  background  diagnostic 
should  provide  coverage  to  the  maximum  extent  possible  without  interfering  with 
normal  station  operation.  Failure  of  any  test  in  the  background  diagnostic  should 
cause  the  module  to  re-execute  the  failed  test  to  screen  out  transient  anomalous 
responses.  If  the  failure  is  confirmed,  the  module  should  become  immediately 
disabled. 

Analysis  Recommendation:  System  design  simulation  tools  should  be  used 
to  verify  operation  of  the  BIT.  These  tools  should  include  fault  simulations  as  well  as 
operational  simulation. 

Test  Recommendation:  Hardware  demonstration  should  be  conducted  early  in 
the  development  phase  to  verify  simulation  results  through  insertton  of  faults  using 
currently  available  versions  of  the  operational  program,  firmware  and  microcode. 
Hardware  demonstration  may  be  performed  by  physically  inserting  faults  in  a  module 
or  by  instmmenting  a  nrxxlule  to  allow  insertion  of  faults  through  external  methods. 

c.  Mechanical  Packaging  Design 

(1)  Mechanical  Insertion/Extraction-Induced  Stresses 

Design  Guideline:  Each  module  should  withstand,  without  damage  or 
separation,  a  minimum  force  equal  to  at  least  100  pounds  on  insertion  and  four 
ounces  per  contact  on  extraction.  Additionally,  the  backplane  for  the  assembly 
should  withstand  the  same  forces  at  all  module  positions  applied  repeatedly  in  any 
sequence  with  any  combination  of  modules  present  or  missing. 

Analysis  Recommendation:  A  mechanical  loads  analysis  shouid  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 
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Test  Rtcommendatlon:  The  total  computed  force  should  be  applied  to 
simulate  module  insertion  and  extraction.  The  force  should  be  applied  in  2  taconds 
and  maintained  for  15  seconds. 

(2)  Insartlon/Extractlon  Durability 

Design  Guideline:  Modules  should  be  capable  of  withstanding  500  cycies  of 
mating  and  unmating  with  rx>  degradation  of  trxMlule  performance.  The  module 
should  also  be  capable  of  withstanding  500  cycles  of  lateral  displacement  to 
simulate  the  use  of  thermal  clamping  devices.  The  backplane  of  the  module's  host 
assembly  should  be  capable  of  withstanding  500  of  the  same  cycles  on  each  of  its 
module  positions. 

Analysis  Recommendation:  A  mechanical  loads  analysis  should  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 

Test  Recommendation:  Each  module/backplane  position  should  be  subjected 
to  500  cycles  of  insertion/extraction.  The  maximum  specified  insertion  and 
extraction  forces  should  be  applied  in  2  seconds  and  maintained  for  15  seconds. 
Five  hundred  lateral  displacement  cycles  should  be  applied  to  the  module. 

(3)  Mechanical  Vibration-Induced  Stresses 

Design  Guideline:  The  larger  components  are  more  susceptible  to  mechanical 
stresses  because  they  have  a  larger  mass  arvd  because  they  are  more  constrained 
by  the  high  number  of  pin-outs  that  act  as  attachment  points.  Module  stiffness 
should  be  maximized  to  prevent  board  flexing  resulting  in  stress  fractures  at  the 
solder  joints  or  component  leadframe. 

Analysis  Recommendation:  Mechanical  finite  element  analysis  should  be 
performed  to  identify  module  characteristics  throughout  the  specified  vibrational 
environment. 

Test  Recommendation:  Developmental  units  should  be  specially  instmmented 
with  accelerometers  early  in  the  development  program.  These  units  could  use 
dummy  masses  attached  using  the  intended  production  technique.  Standard 
endurance  and  qualification  tests  should  be  performed  in  accordance  with  MIL- 
STD  810,  "Environmental  Test  Methods  and  Engineering  Guidelines." 

(4)  Module  Torque  Stresses 

Design  Guidelines:  The  module  should  be  capable  of  withstanding  a  6  inch- 
pound  torque  applied  in  2  seconds  and  maintained  for  15  seconds  in  both 
directions  along  the  header  in  a  direction  perpendicular  to  the  plane  of  the  header 
without  detrimental  effect  to  the  mechanical  or  electrical  properties  of  the  module. 

Analysis  Recommendation:  A  mechanical  loads  analysis  should  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 
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T«st  Rscommendatlon:  The  required  torque  should  be  applied  in  2  seconds 
arnt  maintained  for  15  seconds.  During  the  time  the  torque  is  applied,  the  module 
should  be  rigidly  supported  with  a  zone  between  the  interface  plane  and  0.5  inch 
above  the  interface  panel. 

(5)  Module  Cantilever  Load 

Design  Guideline:  The  module  should  be  capable  of  withstanding  a  force  of  2 
pounds  applied  perpendicular  to  the  header  height  along  the  center  line  midway 
between  the  two  extractor  holes. 

Analysis  Recommendation:  A  mechanical  loads  analysis  should  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 

Test  Recommendation:  The  required  force  should  be  applied  in  two  directions 
and  should  be  applied  in  2  to  10  seconds  and  maintained  for  10  to  15  seconds 
without  detrimentai  effect  to  the  header  structure. 

(6)  Module  Retention 

Design  Guideline:  Module  retention  techniques  must  be  carefully  designed  to 
integrate  the  insertion  mechanism,  required  connector  insertion  force,  thermal 
contact  area,  and  extraction  mechanism.  Conventional  electronics  have  required 
the  same  considerations,  but  to  a  lesser  degree  because  of  their  more  conventional 
housings. 

Analysis  Recommendation:  Specialized  analyses  should  be  used  to  quantify 
torque  requirements  and  limitations  of  the  wedge-clamping  device,  lever  moments 
of  insertion  or  extraction  devices,  tolerance  buildups  of  the  module  slot  and 
connector  placement  and  mechanical  deflections  of  the  backplane. 

Test  Recommendations:  Standard  endurance  and  qualification  tests  in 
accordance  with  MIL-STD-810,  "Environmental  Test  Methods  and  Engineering 
Guidelines." 

(7)  Connector  Contact  Integrity 

Design  Guideline:  Each  contact  pin.  as  mounted  in  the  connector,  should 
withstand  a  minimum  axial  force  of  20  ounces. 

Analysis  Recommendation:  A  mechanical  loads  analysis  should  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 

Test  Recommendation:  The  required  force  should  be  applied  in  2  seconds 
along  the  length  of  the  contact  in  either  direction  and  maintained  for  15  seconds. 
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(8)  Connector  Float 

Daaign  Guideline:  The  conne  tor-to-module  interface  should  be  sufficiently 
flexible  to  compensate  for  specified  misalignments  or  tolerance  buildup  between 
the  module  and  the  backplane  connector  shells. 

Analysis  Recommendation:  Tolerance  review  should  be  performed  early  in 
design  process. 

Test  Recommendation:  Demonstration  testing  can  be  performed  easily  during 
the  initial  mechanical  design  phase. 

(9)  Keying  Pin  Integrity 

Design  Guideline:  When  installed  in  the  module,  the  keying  pins  should  meet 
the  following  integrity  requirements.  Each  keying  pin  should  withstand  a; 

•  Torque  of  20  inch-ounces 

•  Pullout  force  of  9  pounds 

•  Pushout  force  of  40  pounds 

•  Cantilever  load  of  10  pourxfs 

Analysis  Recommendation:  A  mechanical  loads  analysis  should  be  performed 
to  verify  compliance  with  the  mechanical  requirements. 

Test  Recommendation:  The  required  forces  should  be  applied  to  the  keying 
pin  in  2  seconds  and  maintained  for  15  seconds. 

d.  Power  Supply  Design 

(1)  Overcurrent  Protection 

Design  Guideline:  The  power  supply  should  supply  125  percent  of  its  rated 
output  for  2  ±  0.25  seconds,  after  which  the  power  supply  will  shut  down  (shut 
down  is  defined  as  all  outputs  at  less  than  1  mv  and  1  ma  current,  but  all  status  and 
control  lines  still  operating).  Operation  should  not  resume  until  the  power  supply  is 
reset.  In  addition,  the  power  supply  outputs  should  be  short  circuit  protected. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Specified  operation  of  the  protective  device  should 
be  induced  by  application  of  the  anomalous  condition  protected  against.  Correct 
operation  of  the  protective  device  should  be  observed.  Normal  specified  power 
supply  operation  should  be  verified  after  removal  of  the  anomalous  condition. 
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(2)  Overvoltage  Protection 

Design  Guideline:  The  output  should  be  sensed  for  overvoltage.  An 
overvoltage  on  the  output  should  immediately  shut  down  the  power  supply. 
Operation  should  not  resume  until  the  power  supply  is  reset.  The  overvoltage  limits 
should  be  compatible  with  device  logic  absolute  maximum  limits.  The  overvoltage 
protection  and  sense  circuits  should  be  constructed  such  tnat  an  overvoltage  on  a 
failed  power  supply  will  not  cause  any  other  paralleled  power  supply  to  also  shut 
down. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Specified  operation  of  the  protective  device  should 
be  induced  by  application  of  the  anomalous  condition  protected  against.  Correct 
operation  of  the  protective  device  should  be  obsenred.  Normal  specified  power 
supply  operation  should  be  verified  after  removal  of  the  anomalous  condition. 

(3)  Abnormal  Thermal  Operation 

Design  Guideline:  In  the  event  of  an  above-normal  internal  temperature,  the 
power  supply  should  be  capable  of  continued  operation  at  a  reduced  power  output. 
Thermal  sense  circuits  should  regulate  the  output  to  the  extent  necessary  to  keep 
semiconductor  junctions  at  or  below  specified  levels.  The  power  supply  should 
resume  operation  at  rated  output  if  internal  temperatures  return  to  normal. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Specified  operation  of  the  protective  device  should 
be  induced  by  application  of  the  anomalous  condition  protected  against.  Correct 
operation  of  the  protective  device  should  be  observed.  Normal  specified  power 
supply  operation  should  be  verified  after  removal  of  the  anomalous  condition. 

(4)  Thermal  Shutdown 

Design  Guideline:  When  thermal  limiting  is  no  longer  capable  of  maintaining 
internal  temperature  at  an  acceptable  level,  the  power  supply  should  automatically 
shut  down.  Operation  should  not  resume  until  the  power  supply  is  reset. 
Temperature  sense  circuits  should  remain  active  during  shut  down. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recom  nendation:  Specified  operation  of  the  protective  device  should 
be  induced  by  application  of  the  anomalous  condition  protected  against.  Correct 
operation  of  tf  e  protective  device  should  be  observed.  Normal  specified  power 
supply  operation  should  be  verified  after  removal  of  the  anomalous  condition. 


A-32 


ROME  LABORATORY  RELIABILITY  ENGINEER'S  TOOLKIT 


EXAMPLE  DESIGN  GUIDELINES 


(5)  Power  Supply  Status  Reporting 

Design  Guideline:  There  should  be  an  interface  on  each  power  supply  module 
that  will  allow  data  communication  between  the  power  supply  and  a  CPU  located  on 
a  separate  nKjdule.  Each  power  supply  module  will  be  addressed  individually.  The 
data  and  control  lines  should  interface  to  the  power  supply  module  through  the 
backplane  connector.  The  following  power  supply  parameters  should  be  read  by 
the  CPU: 


•  Overcurrent  status 

•  Overvoltage  status 

•  Thermal  limiting  mode  status 

•  Thermal  shutdown  status 

•  Percentage  of  full  output  power  available 

The  following  commands  should  be  issued  by  the  CPU  to  the  power  supply 
module: 


•  Reset 

•  Percentage  of  full  output  power  required 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Specified  operation  of  the  protective  device  (i.e., 
monitoring  mechanism  and  control)  should  be  induced  by  application  of  the 
anomalous  condition  protected  against.  Correct  operation  of  the  protective  device 
should  be  observed.  Normal  specified  power  supply  operation  should  be  verified 
after  removal  of  the  anomalous  condition. 

(6)  Power  Supply  Input  Protection 

Design  Guideline:  The  power  supply  should  automatically  shut  down  if  the 
input  voltage  is  not  within  the  specified  allowable  range,  and  at  any  time  when  the 
control  circuits  in  the  power  supply  do  not  have  adequate  voltage  to  regulate  the 
outputs.  This  should  include  the  time  during  nonnal  start-up  when  generators  are 
not  producing  their  normal  output  voltage. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Specified  operation  of  the  protective  device  should 
be  induced  by  application  of  the  anomalous  condition  protected  against.  Correct 
operation  of  the  protective  device  should  be  observed.  Normal  specified  power 
supply  operation  should  be  verified  after  removal  of  the  anomalous  condition. 
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(7)  Backplane  Conditions 

Design  Guideline:  A  sufficient  number  of  connector  pins  sfK>uld  be  paralleled 
so  that  no  backplane  connector  pin  carries  more  than  5  amps  of  cunent. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  throughout  the  design  process. 

Test  Recommendation:  Not  applicable. 

(8)  M-of-N  Power  Supply  Redundancy 

Design  Guideline:  The  quantity  of  power  supplies  for  a  system  of  functional 
elements  should  be  determined  to  allow  uninteroipted  operatton  if  one  of  the 
power  supplies  fails.  When  all  power  supplies  are  functional,  they  should  share  the 
system  load  equally  by  operating  at  reduced  output.  If  the  system  power 
requirement  is  less  than  that  available  from  one  power  supply,  redundancy  should 
not  be  used  unless  a  critical  function  is  involved. 

Analysis  Recommendation:  Compliance  should  be  verified  by  electrical  loads 
analysis. 

Test  Recommendation:  Not  applicable. 

(9)  Current  Sharing 

Design  Guideline:  The  power  supplies  should  be  constructed  so  that  units 
which  have  the  same  output  voltage  may  operate  in  parallel.  The  design  should  be 
such  that  power  supply  failures  will  not  cause  degradation  of  parallel  power 
supplies.  Each  power  supply  should  provide  its  proportional  share  (±10%)  of  the 
total  electric  load  required  at  the  configured  output  voltage. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  as  a  part  of  the  design  process. 

Test  Recommendation:  A  demonstration  should  be  conducted  under  load  to 
verify  that  the  parallel  power  supplies  power  up  and  power  down  in  unison.  Failure 
and  reset  of  one  of  the  power  supplies  should  be  simulated  or  induced  to 
demonstrate  proper  operation  of  the  remaining  units  through  the  transition. 

(10)  Protective  Device  Operation 

Design  Guideline:  During  parallel  operation,  each  power  supply  protective 
device  should  be  capable  of  sensing  and  operating  independently  of  the  other 
power  supplies.  Master-slave  type  operation  should  not  be  permitted  under  any 
circumstances. 

Analysis  Recommendation:  Compliance  with  the  specified  operation  should 
be  verified  as  a  part  of  the  design  process. 
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Test  Recommendation:  A  demonstration  should  be  conducted  under  load  to 
verify  proper  operatton  of  each  protective  device  during  parallel  operation. 

e.  Memory  Fault  Tolerance 

(1)  Block  Masking 

Design  Guideline:  Known  locations  of  defective  memory  should  be  mapped 
out  of  the  memory  directories.  In  this  manner,  permanently  failed  cells  can  be 
prevented  from  contributing  to  double  error  occurrences  in  combination  with  soft 
errors.  At  power-up  or  reinitialization,  BIT  should  perform  a  memory  test  routine  and 
leave  a  memory  map  of  all  good  blocks.  At  the  conclusion  of  the  memory  test 
routine,  all  words  contained  in  the  memory  blocks  marked  good  should  have  been 
initialized  in  an  error  free  data  pattern.  Program  loader  software  should  make  use  of 
the  good  memory  block  map,  the  process  memory  mapping  registers,  and 
information  stored  in  program  file  headers  to  load  distributed  operating  systems  and 
application  programs  into  the  remaining  good  areas  of  main  memory.  Repair  or 
replacement  of  the  module  should  not  be  required  until  the  number  of  remaining 
good  blocks  of  memory  are  insufficient  to  meet  operational  requirements. 

Analysis  Recommendation:  An  analysis  should  be  performed  to  identify  the 
optimum  combination  of  component/bit  mapping,  hardware  control  and  sofhvare 
control. 

Test  Recommendation:  Not  applicable. 

(2)  Error  Detection/Correction 

Design  Guideline:  As  a  minimum,  single  error  correct/double  error  detect  code 
shouM  be  used  in  large  bulk  semiconductor  memories.  It  should  be  considered  in 
any  application  involving  large  amounts  of  semiconductor  memory,  but  may  impose 
unacceptable  speed  and  complexity  penalties  in  some  applications  (e.g.,  CPU). 

Analysis  Recommendation:  A  detailed  timing  analysis  should  be  conducted  to 
determirie  the  impact  of  this  technique  on  the  specific  application. 

Test  Recommendation:  System  bench  testing  should  be  used  to  insert  faults 
and  confirm  expected  system  operation. 
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1.0  RellabilKy  Demonstration  Testing:  This  appendix  presents  tables  and 
examples  which  summarize  the  following; 

•  MIL-HDBK-781  "Reliability  Test  Methods,  Plans  and  Environments  for 
Engineering  Development,  Qualification  and  Production’ 

•  Confidence  Interval  Calculations 

•  Poisson's  Exponential  Binomial  Limits 

2.0  MIL-HDBK-781  Test  Plans:  Tables  5-1  and  5-2  summarize  standard  test 
plans  as  defined  in  MIL-HDBK-781.  These  plans  assume  an  exponential  failure 
distribution.  For  nonexponential  situations  the  risks  are  different. 

The  fixed  length  test  plans  (Table  5-1)  must  be  used  when  the  exact  length  and 
cost  of  the  test  must  be  known  beforehand  and  when  it  is  necessary  to 
demonstrate  a  specific  MTBF  to  a  predetermined  confidence  level  by  the  test  as 
well  as  reach  an  accept/reject  decision. 

The  probability  ratio  sequential  test  (PRST)  plans  (Table  5-2)  will  accept  material  with 
a  high  MTBF  or  reject  material  with  a  very  low  MTBF  more  quickly  than  fixed  length 
test  plans  having  similar  risks  and  discrimination  ratios.  However,  different  MTBF's 
may  be  demonstrated  by  different  accept  decision  points  for  the  same  test  plan  and 
the  total  test  time  may  vary  significantly. 

Additional  guidance  on  test  plan  selection  is  provided  in  Section  T,  Topic  T5. 

2 . 1  Fixed  Length  Test  Plan  Example:  If  the  design  goal  MTBF  (Oq)  for  a 
system  is  specified  as  750  hours  and  Test  Plan  XID  is  chosen,  the  following 
statements  can  be  made; 

a.  There  is  a  20  percent  probability  of  rejecting  a  system  whose  true  MTBF  is 
750  hours  (producers  risk). 

b.  There  is  a  20  percent  probability  of  accepting  a  system  whose  true  MTBF  is 
500  hours  (consumers  risk). 

c.  The  lower  test  MTBF  (0i)  is  500  hours  (750/1 .5). 

d.  The  duration  of  the  test  is  10,750  hours  (21.5  x  500). 

e.  The  test  will  reject  any  system  which  experiences  18  or  more  failures. 

f .  The  test  will  accept  any  system  which  experiences  1 7  or  less  failures. 
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Table  5-1:  Fixed  Length  MiL-HDBK-781  Reliability 
Demonstration  Test  Plans 
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2 . 2  PRST  Test  Plan  Example:  It  the  design  goal  MTBF  (eo)  for  a  system  is 
specified  as  750  hours  and  Test  Plan  HO  is  chosen,  the  following  statements  can  be 
made: 

a  There  is  a  20  percent  probability  of  rejecting  a  system  whose  tme  MTBF  is 
750  hours  (producers  risk). 

b.  There  is  a  20  percent  probability  of  accepting  a  system  whose  tme  MTBF  is 
500  hours  (consumers  risk). 

c.  The  lower  test  MTBF  (0i )  is  500  hours  (750/1 .5) . 

d.  The  minimum  time  to  an  accept  decision  is  2095  hours  (4.19  x  500). 

e.  The  expected  time  to  an  accept  decision  is  5700  hours  (11.4  x  500). 
(Expected  time  to  decision  based  on  assumption  of  a  tme  MTBF  equal  to  6o). 

f .  The  maximum  time  to  reach  an  accept  decision  is  1 0950  hours  (21 .9  x  500). 

3.0  Confidence  Level  Calculation  (Exponential  Distribution): 

There  are  two  ways  to  end  a  reliability  test,  either  on  a  specified  number  of  failures 
occurring  (failure  truncated),  or  on  a  set  period  of  time  (time  tmncated).  There  are 
usually  two  types  of  confidence  calculations  of  interest,  either  one  sided  (giving  the 
confidence  that  an  MTBF  is  above  a  certain  value)  or  two  sided  (giving  the 
confidence  that  an  MTBF  is  between  an  upper  and  lower  limit).  Table  5-4  provides  a 
simple  means  to  estimate  one  or  two  sided  confidence  limits.  Multiply  the 
appropriate  factor  by  the  observed  total  life  (T)  to  obtain  the  desired  confidence 
interval. 

Example  1  •  Failure  Truncated  Test  with  Replacement:  Twenty  items  are 
tested  and  replaced  until  10  failures  are  observed.  The  tenth  failure  occurs  at  80 
hours.  Determine  the  mean  life  of  the  items  and  the  one-sided  and  two-sided  95% 
confidence  intervals  for  the  MTBF. 

Solution:  The  mean  life  is  (20  items)  (80  hours/items)  / 10  failures  =  160  hours. 
From  Table  5-4,  Note  2  applies,  d  =  (2)(10)  =  20.  The  following  factors  are  obtained 
from  the  table: 

95%  two-sided  lower  factor  =  .0585 
95%  two-sided  upper  factor  =  .208 
95%  one-sided  lower  factor  =  .0635 

Multipling  these  factors  by  1600  total  part  hours  (i.e.,  (20  items)  (80  hours/item)) 
results  in  a  95%  confidence  that  the  MTBF  is  between  94  hours  and  333  hours,  or  a 
95%  confidence  that  the  MTBF  is  at  least  102  hours. 
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Table  5-4:  Factors  for  Calculation  of  Mean  Life 
Confidence  Intervals  from  Test  Data 
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Notes :  1 .  Multiply  value  shown  by  total  part  hours  to  get  MTBF  figures  in  hours. 

2.  d  =  2  (#  of  failures  accumulate  at  test  termination). 

3.  For  the  lower  limit  on  tests  truncated  at  a  fixed  time  where  the  number  of  failures  occurring  is  less  than  the  total  number 
of  items  placed  on  test  initially,  use:  d  =  2  (#  of  failures  accumulated  at  test  termination  +1 ). 
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ExampI*  2  •  Tima  Terminated  Test  without  Replacement:  Twenty  items 
are  placed  on  test  for  100  hours  with  seven  failures  occuring  at  the  10, 16, 17,  25, 
31,  46  and  65  hour  points.  Determine  the  one-sided  lower  90%  confidence 
interval. 

Solution:  The  total  number  of  part  hours  accumulated  is: 

10  +  164-17  +  25  +  31  + 46  +  65-f  (13 non-failed items)  (100  hours)  -  1510  hrs. 
The  MTBF  is  1510  hours/7  failures  -  216  hrs. 

From  Table  5-4,  Note  3  applies,  d  =  2(7+1)  =  16. 

The  factor  from  the  table  is  .0848  for  the  90%  one-sided  lower  limit.  Therefore,  we 
are  90%  confident  that  the  MTBF  is  greater  than  (.0848)(1510  hours) »  128  hours. 

4.0  Poisson  Distribution:  The  Poisson  distribution  is  useful  in  calculating 
the  probability  that  a  certain  number  of  failures  will  occur  over  a  certain  length  of  time 
for  systems  exhibiting  exponential  failure  distributions  (e.g.,  non-redundant 
electronic  systems).  The  Poisson  model  can  be  stated  as  follows: 


where 

P(r)  =  probability  of  exactly  r  failures  occurring 

\  =  the  tme  failure  rate  per  hour  (i.e.,  the  failure  rate  which  would  be 

exhibited  over  an  infinite  period) 

t  =  the  test  time 

r  =  the  number  of  failure  occurrences 

e  =  2.71828 . . . , 

!  =  factorialsymbol(e.g.,4!  =  4x3x2x1  =24, 01  =  1,11  =  1 ) 

The  probability  of  exactly  0  failures  results  in  the  exponential  form  of  this  distribution 
which  is  used  to  calculate  the  probability  of  success  for  a  given  period  of  time  (i.e., 

P(0)  =  e’^*).  The  probability  of  more  than  one  failure  occurring  is  the  sum  of  the 
probabilities  of  individual  failures  occurring.  For  example,  the  probability  of  two  or 
less  failures  occurring  is  P(0)  +  P(1)  +  P(2).  Table  5-5  is  a  tabulation  of  exact 
probabilities  used  to  find  the  probability  of  an  exact  number  of  failures  occurring. 
Table  5-6  is  a  tabulation  of  cumulative  probabilities  used  to  find  the  probability  of  a 
specific  number  of  failures,  or  less,  occurring. 
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4 . 1  Polsaon  Exampl*  1 :  H  the  true  MTBF  of  a  system  is  200  hours  and  a 
reliability  demor^ration  test  is  conducted  for  1000  hours,  what  is  the  probability  of 
accepting  the  system  if  three  or  less  failures  are  allowed? 

t  1000 

Solution:  Expected  number  of  failures  -  Xt  -  iljjjgp  “  200 


From  Table  5-6,  the  probability  of  three  or  less  failures  (probability  of  acceptance) 
given  that  five  are  expected  is  .265.  Therefore,  there  is  only  a  26.5  percent  chance 
that  this  system  will  be  accepted  if  subjected  to  this  test. 

4.2  Poisson  Example  2:  A  system  has  an  MTBF  of  50  hours.  What  is  the 
probability  of  two  or  more  failures  during  a  10  hour  mission? 

Solution:  Expected  number  of  failures  -  ^ 

The  probability  of  two  or  more  failures  is  one  minus  the  probability  of  one  or  less 
failures.  From  Table  5-6,  P(r  ^1 )  when  .2  are  expected  is  .982. 

P{rs:2)=.1  -P(r^1) 

1  -  .982».018 


Therefore,  there  is  a  very  remote  chance  (1.8  percent)  that  a  system  with  a  50  hour 
MTBF  will  experience  two  or  more  failures  during  a  10  hour  mission. 

4 . 3  Poisson  Example  3:  A  system  has  an  MTBF  of  50  hours.  What  is  the 
probability  of  experieno'ng  two  failures  during  a  10  hour  mission? 


Solution:  Expected  number  of  failures  > 


t 

MTBF 


JO 

50 


.2 


From  Table  5-5,  the  probability  of  experiencing  exactly  two  failures  when  .2  are 
expected  is  .017  or  1.7  percent.  It  should  be  noted  that  the  probability  of 
experiencing  two  or  more  failures,  as  determined  in  the  last  example,  can  also  be 
determined  from  this  table  by  adding  P(r  =  2)  +  P(r  =  3)  when  .2  are  expected. 
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Table  5-5:  Summation  of  Terms  of  Poisson's  Exponential 
Binomial  Limit 

iCt’O  times  the  probability  of  exactly  r  failure  occurrences  given  an  average 
number  of  occurrences  equal  to  Xt. 
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Table  5-6:  Summary  of  Terms  of  Poisson's  Exponential 
Binomial  Limit 

1000  times  the  probability  of  r  or  less  failure  occurrences  given  an  average 
number  of  occurrences  equal  to  Xt. 
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1.0  RGT  Definition:  MIL-STD-785  distinguishes  reliability  growth  testing 
(RGT)  from  reliability  qualSication  testing  (RQT)  as  follows: 

Reliability  Growth  Test  (RGT):  A  series  of  tests  conducted  to  disclose 
deficiencies  and  to  verify  that  corrective  actions  will  prevent  recurrence  in  the 
operational  inventory.  (Also  known  as  TAAF’  testing). 

Reliability  Qualification  Test  (RQT):  A  test  conducted  under  specified 
conditions,  by,  or  on  behalf  of,  the  government,  using  items  representative  of  the 
approved  production  configuration,  to  determine  compliance  with  specified 
reliability  requirements  as  a  basis  for  production  approval.  (Also  known  as  a 
’Reliability  Demonstration,’  or  ’Design  Approval’  test.) 

2.0  RGT  Application  Effectiveness:  An  effective  way  to  explain  the 
concept  of  RGT  is  by  addressing  the  most  frequently  asked  questions  relative  to  its 
use  as  summarized  from  ’Reliability  Growth  Testing  Effectiveness’  (RADC-TR-84- 
20).  For  more  information  consult  this  reference  and  MIL-HDBK-189,  ’Reliability 
Growth  Management.’ 

Who  pays  for  the  RGT?  Does  the  government  end  up  paying  more? 

The  usual  case  is  that  the  government  pays  for  the  RGT  as  an  additional  reliability 
program  cost  and  in  stretching  out  the  schedule.  The  savings  in  support  costs 
(recurring  logistics  costs)  exceed  the  additional  initial  acquisition  cost,  resulting  in  a 
net  savings  in  Life  Cycle  Cost  (LCC).  The  amount  of  these  savings  is  dependent  on 
the  quantity  to  be  fielded,  the  maintenance  concept,  the  sensitivity  of  LCC  to 
reliability  and  the  level  of  development  required.  It  is  the  old  ’pay  me  now  or  pay  me 
later  situation’  which  in  many  cases  makes  a  program  manager's  situation  difficult 
because  his  or  her  performance  is  mainly  based  on  the  ’now’  performance  of  cost 
and  schedule. 

Does  RGT  allow  contractors  to  "get  away  with"  a  sloppy  Initial  design 
because  they  can  fix  It  later  at  the  government’s  expense?  It  has 

been  shown  that  unforeseen  problems  account  for  75%  of  the  failures  due  to  the 
complexity  of  today's  equipment.  Too  low  an  initial  reliability  (resulting  from  an 
inadequate  contractor  design  process)  will  necessitate  an  unrealistic  growth  rate  in 
order  to  attain  an  acceptable  level  of  reliability  in  the  allocated  amount  of  test  time. 
The  growth  test  should  be  considered  as  an  organized  search  and  correction 
system  for  reliability  problems  that  allows  problems  to  be  fixed  when  it  is  least 
expensive.  It  is  oriented  towards  the  efficient  determination  of  corrective  action. 
Solutions  are  emphasized  rather  than  excuses.  It  can  give  a  nontechnical  person 
an  appreciation  of  reiiabiiity  and  a  way  to  measure  its  status. 

Should  all  development  programs  have  some  sort  of  growth 
program?  The  answer  to  this  question  is  yes  in  that  ali  programs  should  analyze 
and  correct  failures  when  they  occur  in  pre^alification  testing.  A  distinction  should 
be  in  the  level  of  formality  of  the  growth  program.  The  less  challenge  there  is  to  the 
state-of  the-art,  the  less  formal  (or  rigorous)  a  reliability  growth  program  should  be. 
An  extreme  example  would  be  the  case  of  procuring  off-the-shelf  equipment  to  be 
part  of  a  military  system.  In  this  situation,  which  really  isnl  a  development,  design 
flexibility  to  correct  reliability  problems  is  mainly  constrained  to  newly  developed 
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interfaces  between  the  "boxes"  making  up  the  system.  A  rigorous  growth  program 
would  be  inappropriate  but  a  failure  reporting  and  corrective  action  system 
(FRACAS)  should  still  be  implemented.  The  other  extreme  is  a  developmental 
program  applying  technology  that  challenges  the  state-of-the-art.  In  this  situation  a 
much  greater  amount  of  design  flexibility  to  correct  unforeseen  problems  exists. 
Because  the  technology  is  so  new  and  challenging,  it  can  be  expected  that  a 
greater  number  of  unforeseen  problems  will  be  surfaced  by  growth  testing.  All 
programs  can  benefit  from  testing  to  find  reliability  problems  and  correcting  them 
prior  to  deployment,  but  the  number  of  problems  likely  to  be  corrected  and  the  cost 
effectiveness  of  fixing  them  is  greater  for  designs  which  are  more  complex  and 
challenging  to  the  state-of-the-art. 

How  does  the  applicability  of  reliability  growth  testing  vary  with  the 
following  points  of  a  development  program? 

(1)  Complexity  of  equipment  and  challenge  to  state-of-the-art? 

The  more  complex  or  challenging  the  equipment  design  is,  the  more  likely 
there  will  be  unforeseen  reliability  problems  which  can  be  surfaced  by  a 
growth  program.  However,  depending  on  the  operational  scenario,  the 
number  of  equipments  to  be  deployed  and  the  maintenance  concept, 
there  may  be  a  high  LCC  payoff  in  using  a  reliability  growth  program  to  fine 
tune  a  relatively  simple  design  to  maximize  its  reliability.  This  would  apply  in 
situations  where  the  equipments  have  extremely  high  usage  rates  and  LCC 
is  highly  sensitive  to  MTBF. 

(2)  Operational  environment?  All  other  factors  being  equal,  the  more 
severe  the  environment,  the  higher  the  payoff  from  growth  testing.  This  is 
because  severe  environments  are  more  likely  to  inflict  unforeseen  stress 
associated  with  reliability  problems  that  need  to  be  corrected. 

(3)  Quantity  of  equipment  to  be  produced?  The  greater  the 
quantities  of  equipment,  the  more  impact  on  LCC  by  reliability  improvement 
through  a  reliability  growth  effort. 

What  reliability  growth  model(s)  should  be  used?  The  model  to  be  used, 
as  MIL-HDBK-189  says,  is  the  simplest  one  that  does  the  job.  Certainly,  the  Duane 
is  most  common,  probably  with  the  AMSAA  developed  by  Dr.  Larry  H.  Crow  of  the 
Army  Materiel  Systems  Analysis  Activity  second.  They  both  have  advantages;  the 
Duane  being  simple  with  parameters  having  an  easily  recognizable  physical 
interpretation,  and  the  AMSAA  having  rigorous  statistical  procedures  associated 
with  it.  MIL-HDBK-189  suggests  the  Duane  for  planning  and  the  AMSAA  for 
assessment  and  tracking.  When  an  RQT  is  required,  the  RGT  should  be  planned 
and  tracked  using  the  Duane  model;  otherwise,  the  AMSAA  model  is 
recommended  for  tracking  because  it  allows  for  the  calculation  of  confidence  limits 
around  the  data. 

Should  there  be  an  accept/reject  criteria?  The  purpose  of  reliability 
growth  testing  is  to  uncover  failures  and  take  corrective  actions  to  prevent  their 
recurrence.  Having  an  accept/reject  criteria  is  a  negative  contractor  incentive 
towards  this  purpose.  Monitoring  the  contractor's  progress  and  loosely  defined 
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thresholds  are  needed  but  placing  accept/reject  criteria,  or  using  a  growth  test  as  a 
demonstration,  defeat  the  purpose  of  running  them.  A  degree  of  progress 
monitoring  is  necessary  even  when  the  contractor  knows  that  following  the 
reliability  growth  test  he  will  be  held  accountable  by  a  final  RQT.  Tight  thresholds 
make  the  test  an  RQT  in  disguise.  Reliability  growth  can  be  incentivized  but 
shouldm  be.  To  reward  a  contractor  for  meeting  a  certain  threshold  in  a  shorter  time 
or  by  indicating  "if  the  RGT  results  are  good,  the  RQT  wilt  be  waived,”  the 
contractor's  incentive  to  ‘find  and  fix”  is  diminished.  The  growth  test's  primary 
purpose  is  to  improve  the  design,  not  to  evaluate  the  design. 

What  Is  the  relationship  between  an  RQT  and  RGT?  The  RQT  is  an 

"accounting  task”  used  to  measure  the  reliability  of  a  fixed  design  configuration.  It 
has  the  benefit  of  holding  the  contractor  accountable  some  day  down  the  road  from 
his  initial  design  process.  As  such,  he  is  encouraged  to  seriously  carry  out  the  other 
design  related  reliability  tasks.  The  RGT  is  an  ‘engineering  task"  designed  to 
improve  the  design  reliability.  It  recognizes  that  the  drawing  board  design  of  a 
complex  system  cannot  be  perfect  from  a  reliability  point  of  view  and  allocates  the 
necessary  time  to  fine  tune  the  design  by  finding  problems  and  designing  them 
out.  Monitoring,  tracking  and  assessing  the  resulting  data  gives  insight  into  the 
efficiency  of  fhe  process  and  provides  nonreliability  persons  with  a  tool  for 
evaluating  the  development's  reliability  status  and  for  reallocating  resources  when 
necessary.  The  forms  of  testing  serve  very  different  purposes  and  complement 
each  other  in  development  of  systems  and  equipments.  An  RGT  Is  not  a 
substitute  for  an  RQT  or  any  other  reliability  design  tasks. 

How  much  validity/confidence  should  be  placed  on  the  numerical 
results  of  RGT?  Associating  a  hard  reliability  estimate  from  a  growth  process, 
while  mathematically  practical,  has  the  tone  of  an  assessment  process  rather  than 
an  improvement  process,  especially  if  an  RQT  assessment  will  not  follow  the  RGT. 
In  an  ideal  situation,  where  contractors  are  not  driven  by  profit  rrwtives,  a  reliability 
growth  test  could  serve  as  an  improvement  and  assessment  vehicle.  Since  this  is 
not  the  real  world,  the  best  that  can  be  done  if  meaningful  quantitative  results  are 
needed  without  an  RQT,  is  to  closely  monitor  the  contractor  RGT.  Use  of  the 
AMSAA  model  provides  the  necessary  statistical  procedures  for  associating 
confidence  levels  with  reliability  results.  In  doing  so,  closer  control  over  the 
operating  conditions  and  failure  determinations  of  the  RGT  must  be  exercised  than 
if  the  test  is  for  improvement  purposes  only.  A  better  approach  is  to  use  a  less 
closely  controlled  growth  test  as  an  improvement  technique  (or  a  structured 
extension  of  FRACAS,  with  greater  emphasis  on  corrective  action)  to  fine  tune  the 
design  as  insurance  of  an  accept  decision  in  an  RQT.  With  this  approach, 
monitoring  an  improvement  trend  is  more  appropriate  than  development  of  fiard 
reliability  estimates.  Then  use  a  closely  controlled  RQT  to  determine  acceptance 
and  predict  operational  results. 

3.0  Duane  Model:  Because  the  Duane  model  is  the  one  most  commonly 
used,  it  will  be  further  explained.  The  model  assumes  that  the  plot  of  MTBF  versus 
time  is  a  straight  line  when  plotted  on  log-log  paper.  The  main  advantage  of  this 
model  is  that  it  is  easy  to  use.  The  disadvantage  of  the  model  is  it  assumes  that  a  fix 
is  incorporated  immediately  after  a  failure  occurs  (before  further  test  time  is 
accumulated).  Because  fixes  are  not  developed  and  implemented  that  easily  in  real 
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life,  this  Is  rarely  the  case.  Despite  this  problem,  it  is  still  considered  a  useful 
planning  tool.  Below  is  a  brief  summary  of  the  Duane  model. 


a. 

Growth  Rate 

AMTBF 

“  “  ATIME 

b. 

Cumulative  MTBF 

MTBFc 

c. 

Instantaneous  MTBF 

MTBFc 

MTBFi  ^ 

'  1  -  a 

d. 

Test  Time 

1 

m  m 

T  =  [(MTBFi)(K)(l-o)  ]o 


e .  Preconditioning  period  at  which  system  will  realize  an  initial  MTBF  of  MTBFc 
Tpc  =  ^  (MTBFpRED) 

where 

k  =  a  constant  which  is  a  function  of  the  initial  MTBF 
a  -  the  growth  rate 
T  =  the  test  time 

The  instantaneous  MTBF  is  the  model's  mathematical  representation  of  the  MTBF  if 
all  previous  failure  occurrences  are  corrected.  Therefore,  there  is  no  need  to 
selectively  purge  corrected  failures  from  the  data. 

The  scope  of  the  up-front  reliability  program,  severity  of  the  use  environment  and 
system  state-of-the-art  can  have  a  large  effect  on  the  initial  MTBF  and,  therefore, 
the  test  time  required.  The  aggressiveness  of  the  test  team  and  program  office  in 
ensuring  that  fixes  are  developed  and  implemented  can  have  a  substantial  effect 
on  the  growth  rate  and,  therefore,  test  time.  Other  important  considerations  for 
planning  a  growth  test  are  provided  in  Table  6-1. 

Table  6-1:  RGT  Planning  Considerations 


*  To  account  for  down  time,  calendar  time  should  be  estimated  to  be  roughly 
twice  the  number  of  test  hours. 

•  A  minimum  test  length  of  5  times  the  predicted  MTBF  should  always  be  used 
(if  the  Duane  Model  estimates  less  time).  Literature  commonly  quotes  t^ical 
test  lengths  of  from  5  to  25  times  the  predicted  MTBF 

*  For  large  MTBF  systems  (e.g.,  greater  than  1000  hours),  the  preconditioning 
period  equation  does  not  hold;  250  hours  is  commonly  used. 

•  The  upper  limit  on  the  growth  rate  is  .6  (growth  rates  above  .5  are  rare). 
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4 . 0  Prediction  of  Reliability  Growth  Expected:  It  is  possible  to  estimate 
the  increase  in  reliability  that  can  be  expected  for  an  equipment  undergoing  a 
reliability  growth  development  program.  The  methodology  to  do  this  is  documented 
in  RADC-TR-86-148  "Reliability  Growth  Predidion." 

4 . 1  Terms  Explained: 


Xp  =  MIL-HDBK-21 7  predicted  equipment  failure  rate  (failures  per  hour). 

Fm  »  Equipment  maturity  factor.  Estimated  as  the  percentage  of  the  design 
which  is  new. 


Ki  s  Number  of  failures  in  the  equipment  prior  to  test. 

Ki  =  30,000  X  Fm  X  Xp 

Fa  =  Test  acceleration  factor,  based  on  the  degree  to  which  the  test 

environment  cycle  represents  the  operational  environmental  cycle. 

P  ^  Toperattonal  Length  of  operational  life 
^  Ttest  ~  Length  of  test  cycle 


K2  = 


0.0005 

6.5 


(Fa) 


4.2  Prediction  Procedure: 


a  Calculate  the  equipment  MTBF  prior  to  test,  MTBF(o): 

b.  Calculate  the  equipment  MTBF  after  T  hours  of  growth  testing: 


MTBF(t)  = 


Fa 

(FA)(>.p)  +  KiK2e-'<2‘ 


c.  Percent  MTBF  Improvement  =  x  100 

4.3  Example: 

To  illustrate  application  of  the  reliability  growth  prediction  procedure,  consider  the 
following  hypothetical  example  of  an  avionics  equipment  to  be  subjected  to 
reliability  growth  testing  during  full-scale  development.  The  following  assumptions 
are  made: 
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•  40  percent  of  the  equipment  is  new  design;  the  remainder  is  comprised  of 
mature,  off-the-shelf  items. 

•  The  MIL-HDBK-217  MTBF  prediction  is  300  hours  (Ap  =  1/300). 

•  An  RGT  program  is  to  be  conducted  during  which  3000  hours  will  be 
accumulated  on  the  equipment. 

•  The  operational  cycle  for  the  equipment  is  a  ten-hour  aircraft  mission. 

•  The  test  profile  eliminates  the  perbd  of  operation  in  a  relatively  benign 
environment  (e.g.,  the  cruise  portion  of  the  mission)  resulting  in  a  test  cycle 
of  two  hours. 

The  predicted  number  of  failures  in  the  equipment  prior  to  testing  is: 

Ki  =  30,000  X  (0.4)  X  (1/300)  =  40 

The  initial  MTBF  is: 

-  [300  *  -  'se 

The  test  acceleration  factor  is: 


The  rate  of  surfacing  failures  during  the  test  is: 


Ka  =  X  5  =  0.0003846 


The  equipment  MTBF  after  incorporation  of  corrective  actions  to  eliminate  those 
failures  identified  in  the  RGT  program  is: 


MTBF(3000)  = 


(5  X  ^  +  40  X  0.0003846  *  ^°°°) 


=  232  hours 


Hence,  the  predicted  reliability  growth  is  from  an  initial  MTBF  of  156  hours  to  an 
improved  MTBF  of  232  hours,  approximately  a  50  percent  improvement. 
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1.0  Testing:  This  appendix  presents  a  listing  of  the  possible  maintainability 
demonstration  plans  as  determined  from  MIL-STD-471  ‘Maintainability  Verification 
Demonstration/Evaluation*  and  general  plans  for  testability  demonstrations.  In  most 
circumstances,  maintainability  and  testability  demonstrations  are  linked  together 
and  tested  concurrently.  Concurrent  testirrg  is  cost  effective  and  reduces  the  total 
number  of  tasks  that  must  be  denmnstrated. 

2.0  Maintainability:  For  maintainability  there  are  two  general  classes  of 
demonstration:  tests  that  use  naturally  occurring  failures,  and  tests  that  require 
induced  failures.  Natural  failure  testing  requires  a  long  test  period,  while  induced 
testing  is  only  limited  to  the  time  to  find  fix  the  fault.  To  njn  a  thirty  task  test  using 
induced  faults,  the  test  time  should  be  less  than  a  week  while  a  natural  failure  test 
could  require  six  months  or  more  depending  on  the  failure  frequency. 

2.1  Maintainability  Test  Recommendations  (See  Table  7-i  for  complete 
MIL-STD-471  Test  Plan  listing.) 

•  Test  plan  eight  should  be  used  if  dual  requirements  of  the  mean  and  either 
90th  or  95th  percentile  of  maintenance  times  are  specified  and  a  lognormal 
distribution  is  expected. 

•  Test  plan  nine  should  be  used  for  mean  corrective  maintenance,  mean 
preventive  maintenance  or  combination  of  corrective  and  preventive 
maintenance  testing.  Any  underlying  distribution  can  be  used  in  this  test 
plan. 

•  The  sample  size  of  the  tasks  to  be  demonstrated  should  exceed  400  to 
reduce  the  risk  of  biasing  the  test  results. 

•  The  task  samples  must  be  based  on  the  failure  rate  distribution  of  the 
equipment  to  be  tested. 

•  Final  selection  of  the  tasks  to  be  demonstrated  must  be  performed  by  the 
procuring  activity  just  prior  to  test. 

3.0  Testability:  Three  parameters  which  are  usually  tested  in  a  testability 
demonstration  are;  the  fault  detection  capability,  the  fault  isolation  capability,  and 
the  false  alarm  rate.  Fault  detection  and  isolation  parameters  are  demonstrated 
using  induced  faults,  while  false  alarm  demonstrations  are  based  on  naturally 
occurring  events.  (See  Table  7-2  for  more  information  on  testability  demonstration.) 

3.1  Testability  Test  Recommendations: 

•  Fault  detection  and  isolation  testing  should  be  combined. 

•  Test  samples  should  exceed  400  to  reduce  any  bias. 

•  The  test  samples  should  be  based  on  the  failure  rate  distribution  of  the 
equipment  to  be  tested. 

•  False  alarm  demonstration  should  be  a  data  collection  effort  using  all  the 
contractor  planned  tests  such  as  acceptance  testing  and  initial  operating 
tests  (lOT). 
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Table  7-1: 
Summary 
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Table  7-2:  Testability  Demonstration  Plans 
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1.0  Air  Force  Databases 

G063:  Maintenance  and  Operational  Data  Access  System  (MODAS): 

MODAS  is  an  on-line  data  storage  and  access  system  to  track  field  maintenance 
events  for  purposes  of  product  improvement,  monitoring  product  performance  and 
enhancing  reliability  and  maintainability.  The  data  base  is  menu  driven  and  contains 
data  on  both  ground  and  airborne  equipment.  Data  can  be  sorted  and  accessed  in 
several  ways.  For  example,  data  on  the  top  50  most  maintained  subsystems  on  an 
aircraft  can  be  viewed  for  a  specific  geographical  area  or  for  a  specific  aircraft 
platform.  Mean-time-between-maintenance  actions  (MTBMA)  can  be  calculated 
from  the  data  on  airborne  systems  because  flight  hours  are  also  provided  with  the 
number  of  maintenance  actions. 

Air  Force  Materiet  Command/ENiT 
Wright-Patterson  AFB  OH  45433-5001 
(513)  257-6021 
DSN;  787-6021 

Reliability  and  Maintainability  information  System  (REMIS):  REMIS  is  a 
central  source  on-line  data  access  system  containing  all  unclassified  maintenance, 
operational,  configuration  and  selected  supply  information  for  USAF  weapon 
systems.  REMIS,  when  completed,  will  be  a  conglomeration  of  almost  all  of  the  Air 
Force  databases. 

Air  Force  Materiel  CommancMWSC/SR 
Wright-Patterson  AFB  OH  45433-5001 
(513)  429-5076 
DSN:  787-5076 

D041:  Requirements  Computation  System:  This  system  contains  part 
failure  rates  and  data  assets  for  recoverable  items. 

Air  Force  Materiel  Command/XRII 
Wright-Patterson  AFB  OH  45433-5001 
(513)  257-5361 
DSN;  787-5361 

Tactical  Interim  CAMMS  and  REMIS  Reporting  System  (TICARRS): 

This  system  reports  on  F-15  and  F-16  aircraft  inventory,  utilization  and  maintenance. 

Dynamics  Research  Corporation 
60  Frontage  Rd 
Andover  MA  01810 
(800)  522-4321,  x2612 

G021:  Product  Quality  Deficiency  Reporting  (PQDR):  This  system 
provides  procedures  for  assuring  that  the  quality  deficiency  dafa  generated  by 
using  activities  are  effective  and  appropriate  management  levels  are  apprised  of 
quality  problems.  Also,  it  provides  tracking  to  assure  that  corrective  and  preventive 
actions  are  carried  out  to  alleviate  future  quality  problems. 
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Air  Force  Materiel  Command/ENI 
Wright  Patterson  AFB  OH  45433-5001 
(513)  257-6021 
DSN:  787-6021 

Systems  Effectiveness  Oats  System  (SEDS):  This  system  contains  R&M 
test  data  obtained  during  test  and  evaluation  of  new  systems  at  Eglin  AFB  FL. 

Aeronautical  Systems  Center  /ENM 
Eglin  AFB  FL  32542 
(904)  882-8652 
DSN:  872-8652 

Visibility  and  Management  of  Operating  and  Support  Costs  Program 
(VAMOSC):  This  system  contains  operating  and  support  cost  for  parts  used  in 
over  100  aircraft. 

Air  Force  Cost  Analysis  Agency/ISM 
Wright-Patterson  AFB  OH  45433 
(513)  257-4963 
DSN:  787-4963 

Reliability,  Availability,  Maintainability  of  Pods  (RAMPOD) 

Warner  Robins  Air  Logistics  Center/LNXA 

RAMPOD  Program  Office 

Robins  AFB  GA 

(912)  926-5404 

DSN:  468-5404 

2.0  Navy  Databases 

3M:  Maintenance,  Material,  Management  System:  3M  is  a  mass-data 
collection  system  which  tracks  maintenance  information  at  the  organizational  and 
intermediate  levels  on  ail  types  of  equipments  and  assemblies  used  on  Navy  ships, 
submarines  and  aircraft. 

Naval  Sea  Logistics  Center 
5450  Carlisle  Pike 
PO  Box  2060,  Code  44 
Mechanicsburg  PA  17055-0795 
(717)  790-2953  (Ships  &  Submarines) 

DSN:  430-2953 
(717)  790-2031  (Avionics) 

DSN:  430-2031 
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Naval  Aviation  Logistica  Data  Analysla  Syatem  (NALDA):  NALDA 
contains  data  similar  to  the  3M  Avionics  database. 

Naval  Aviation  Maintenance  Office 
NAVAiR  Air  Station.  Code  424 
Patuxent  River  MO  20670 
(800)  624-6621 
(301)  863-4454 
OSN:  326-4454 

Marine  Corps  Integrated  Maintenance  Management  System  (MIMMS): 

MIMMS  contains  maintenance  information  at  all  levels  for  all  types  of  equipment  arid 
assemblies  used  in  Marine  Corps  vehicles  and  aircraft. 

Headquarters,  US  Marine  Corps,  HQBN 
Codd  LPP-3 

Washington  DC  20380-0001 
(703)  696-1060 
OSN:  226-1060 

3.0  Army  Databases 

Troop  Support  Sample  Data  Collection  (TSSDC):  TSSDC  is  a  sample 
data  collection  system  which  contains  maintenance  times,  maintenance  actions  and 
operating  houm  of  various  equipment. 

US  Army  Aviation  Troop  Command 
Attn:  AMSAT-I-MDC 
4300  Goodfellow  Blvd. 

St  Louis  MO  63120-1798 
(314)  263-2734 
DSN:  693-2734 

Work  Order  Logistics  File  (WOLF):  WOLF  is  a  maintenance  database 
containing  repair  part  consumption  data  on  fielded  systems. 

Commander 

USAMC  Materiel  Readiness  Support  Activity 

Attn:  AMXMD-RA 

Lexington  KY  40511-5101 

(606)  293-4110 

DSN:  745-4110 
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Raliablllty.  Availability,  Maintainability  and  Loglatlea  Data  Baae 
(RAM/LOG):  RAM/LOG  contains  testing  data  on  Aircraft. 

US  Army  Aviation  Troop  Command 
4300  Goodfellow  Blvd 
St  Louis  MO  63120-1798 
(314)  263-1791 
DSN:  693-1791 

USAMC  Materiel  Readiness  Support  Activity  Deficiency  Reporting 
System 

This  system  tracks  equipment  and  component  deficiencies  for  all  equ'ipments. 
Commander 

USAMC  Materiel  Readiness  Support  Activity 

ATTN:  AMXMD-RS 

Lexington  KY  40511-5101 

(606)  293-3577 

DSN:  745-3577 

4.0  Other  Government  Databases 

Reliability  Analysis  Center  (RAC):  RAC  is  a  Department  of  Defense 
Information  Analysis  Center  sponsored  by  the  Defense  Technical  Information 
Center,  managed  by  the  Rome  Laboratory,  and  currently  operated  by  IIT  Research 
Institute  (IITRI).  RAC  is  chartered  to  collect,  analyze  and  disseminate  reliability 
information  pertaining  to  electronic  systems  and  parts  used  therein.  The  present 
scope  includes  integrated  circuits,  hybrids,  discrete  semiconductors,  microwave 
devices,  opto-electronics  and  nonelectronic  parts  employed  in  military,  space  and 
commercial  applications. 

Data  is  collected  on  a  continuous  basis  from  a  broad  range  of  sources,  including 
testing  laboratories,  device  and  equipment  manufacturers,  government  laboratories 
and  equipment  users  (government  and  non-government).  Automatic  distribution 
lists,  voluntary  data  submittals  and  field  failure  reporting  systems  supplement  an 
intensive  data  solicitation  program. 

Reliability  data  and  analysis  documents  covering  most  of  the  device  types 
mentioned  above  are  available  from  the  RAC.  Also,  RAC  provides  reliability 
consulting,  training,  technical  and  bibliographic  inquiry  senrices. 

For  further  technical  assistance  and  infonnation  on  available  RAC  Services,  contact: 

Reliability  Analysis  Center 

201  Mill  Street 

Rome  NY  13440-6916 

Technical  Inquiries:  (315)337-9933 

Non-technical  Inquiries:  (315)  337-0900 

DSN:  587-4151 
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All  Other  Requests  Should  Be  Directed  To: 

Rome  Laboratory 
ERSS/Duane  A.  Gitmour 
GriHiss  AFB  NY  13441-5700 
Telephone:  (315)  330-2660 
DSN:  587-2660 

Government  Industry  Data  Exchange  Program  (6IDEP):  The  GIDEP 
program  is  a  cooperative  activity  between  government  arid  industry  participants  for 
the  purpose  of  compiling  and  exchanging  technical  data.  It  provides  an  on-line 
menu  driven  means  of  searching  for  desired  information.  Table  8-1  summarizes 
several  separate  GIDEP  data  banks  which  contain  R&M  related  information. 

Table  8-1:  GIDEP  Data  Bank  Summary 


Data  Bank 


Content 


Engineering 

Reliability  and  Maintainability 

Failure  Experience 


Test  reports,  nonstandard  part 
justification  data,  failure  analysis  data, 
manufacturing  processes  data. 

Failure  mode  and  replacement  rate  data 
on  parts,  reports  on  theories,  methods, 
techniques  and  procedures  related  to 
reliability  and  maintainability  practices. 

Failure  information  generated  on 
significant  problems  on  parts, 
processes,  materials,  etc.  Includes 
ALERTS  and  failure  analysis 
information. 


GIDEP  provides  special  senrices  such  as  the  ALERT  system  which  notifies  all 
participants  of  significant  problem  areas  and  the  Urgent  Data  Request  System  which 
allows  all  participants  queried  for  information  to  solve  a  specific  problem.  The 
current  information  found  on-line  is  usually  a  brief  summary  of  a  report  or  collected 
data  which  provides  a  reference  for  further  detailed  information  fourxf  on  microfilm; 
however,  GIDEP  is  working  on  a  new  system  which  will  provide  full  text  reports  and 
ALERTS  on-line. 

GIDEP  Operations  Center 
Corona  CA  91720-5000 
(714)  273-4677 
DSN:  933-4677 
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5.0  Electronic  Bulletin  Boards 


DOD  Field  Failure  Return  Program  (FFRP)  Reliability  Bulletin  Board: 

This  Bulletin  Board  provides  information  concerning  the  DOD  FFRP  program  as  well 
as  providing  a  vehicle  for  both  commercial  and  government  users  to  exchange 
ideas  and  information  on  component  and  system  problems. 


Reliability  Analysis  Center 
201  Mill  Street 
Rome  NY  13440-6916 
(315)  339-7120,  Access 
(315)  339-7043,  Questions 
DSN:  587-4151 


Technical  Data: 

1200  Baud  or  less 
8  Data  bits 
No  Parity 
1  stop  bit 


OESC  Engineering  Standardization  Bulletin  Board:  This  service 
provides  information  on  standard  military  drawings  (SMD)  parts  as  well  as  information 
on  MIL-M-38510  microcircuits.  Examples  include  downloadable  self-extracting  files 
of  standard  military  drawing  microcircuits  (MIL-BUL-103)  and  MIL-STD-1562,  a  listing 
of  standard  microcircuits  cross-referenced  to  commercial  part  numbers.  Many  files 
are  available  in  both  ASCI  text  format  and  formats  compatible  with  popular 
oommerical  data  base  programs. 


Defense  Electronics  Supply  Center 
Dayton  OH  45444 
(513)  296-6046,  Access 
(513)  296-6879,  Questions 
DSN:  986-6879 


Technical  Data: 

2400  Baud  or  less 
8  Data  bits 
No  Parity 
1  stop  bit 


IEEE  Reliability  Society  Bulletin 
Los  Angeles  Chapter 
POBox  1285 

Pacific  Palisades  CA  90272 
(818)  768-7644,  Access 
(213)454-1667,  Questions 


Board  Technical  Data: 

2400  Baud  or  less 
8  Data  bits 
No  Parity 
1  stop  bit 


Statistics  Applications  Board  System 

Statistical  Applications  Institute 
(316)  265-3036 


Technical  Data: 

1200  -  2400  Baud 
8  Data  bits 
No  Parity 
1  stop  bit 
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1.0  RAM  Education  Sources 


The  following  is  a  list  of  organizations  that  offer  various  types  of  R&M  training 
(Ac£KJemic  Offerings,  short  courses,  home  study,  etc.).  This  is  in  no  way  a  complete 
listing  of  all  the  RAM  education  sources.  For  further  information  on  the  individual 
sources,  call  or  write  to  the  address  provided. 

DOO  Programs 


Air  Force  Institute  of  Technology/LS 
Wright-Patterson  AFB  OH  45433 
DSN  785-6336 
(513)  255-6336 


Army  Management  Engineering 
College 
AMXOM/QSAT 
Rock  Island  IL  61299-7040 
DSN:  793-0503 
(309)  782-0503 


Private  Institution  Academic  Programs 


University  of  Arizona 
Aerospace  A  Mechanical  Eng  Dept 
Bldg  16.  Rm  200B 
Tucson  A2  85721 
(602)  621-2495 


University  of  Maryland 
Center  for  Reliability  Engineering 
Chemical  A  Nuclear  Engineering 
College  Park  MD  20742 


New  Jersey  Institute  of  Technology 
Electrical  Engineering  Dept 
Newark  NJ  07102 
(201)  596-3511 


Individual  courses  on  RAM  subjects  have  been  included  in  the  curricula  of  many 
schools,  including  Pennsylvania  State  University.  VPI,  USC,  Virginia  Tech,  SMU 
and  Syracuse  University. 

Short  Course/Home  Study  Programs 


Reliability  Analysis  Center 
201  Mill  Street 
Rome  NY  13440-6916 
(315)  337-0900 


American  Society  for  Quality  Control 
61 1  E.  Wisconsin  Avenue 
PO  Box  3005 
Milwaukee  Wl  53201-3005 
(800)  248-1946 


Society  of  Automotive  Engineers 
400  Commonwealth  Drive 
Warrendale  PA  15096-0001 
(412)  772-7148 


The  Continuing  Engineering 
Education  Center 
George  Washington  University 
Washington  DC  20052 
(800)  424-9773 
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The  following  schools  also  offer  individual  short  courses:  University  of  Albany, 
Georgia  Institute  of  Technology,  University  of  Wisconsin-Madison  and  Milwaukee 
Campuses  and  Clemson  Univers^. 

2.0  R&M  Periodicals 


IEEE  Transactions  on  Reliability 
IEEE  Reliability  Society 
PO  Box  1331 

Piscataway  NJ  08855-1331 
(908)  981-0060 
(quarterly) 

Quality  and  Reliability  Engineering 
International 
John  Wiley  &  Sons  Inc. 
Subscription  Dept  C 
605  Third  Avenue 
New  York  NY  10158 
(bimonthly) 

RAC  Newsletter 
201  Mill  Street 
Rome  NY  13440-6916 
(315)  330-0900 
(quarterly) 


Reliability  Review 

American  Society  for  Quality  Control 
310  West  Wisconsin  Avenue 
Milwaukee  Wl  53203 
(800)  248-1946 
(quarterly) 

Reliability/Maintainability  Technology 
Transition-Fact  Sheet 
RL/ERS 
525  Brooks  Rd 
Griftiss  AFB  NY  13441-4505 
(315)  330-4921 

(biannually) 

RAC  Quarterly 
201  Mill  Street 
Rome  NY  13440-6916 
(315)  330-0900 


3.0  R&M  Symposia  and  Workshops 


IEEE  Reliability  &  Maintainability 
Symposium 

Contact:  IEEE  Reliability  Society 

345  E.  47th  St 
New  York  NY  10017 
(212)  705-7484 


International  Reliability  Physics 
Symposium 
Contact:  Intel  Corp. 

Richard  C.  Blish  II, 
MSSCI-03 

3065  Bowers  Avenue 
Santa  Clara  CA  95052-8126 
(408)  765-2321 


lES  Annual  Technical  Meeting  &  Exposition 
Contact:  lES  National  Office 

940  E.  Northwest  Highway 
Mount  Prospect  IL  60056 
(708)  255-1561 
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Government  Microcircuit  Applications 
Conference 
Contact:  JayMorreale 
Palisades  Institute  for 
Research  Services,  Inc. 

201  Varick  St,  Suite  1140 
New  York  NY  10014 
(212)  620-3371 

4.0  R&M  Textbooks 

There  are  too  many  textbooks  on  R&M  to  list  all  of  them  here.  A  broad  coverage  can 
be  found  in  MIL-HOBK'338,  'Electronic  Reliability  Design  Handbook.*  A  short  list  of 
representative  texts  follows: 

Ascher,  H.  and  Feingoid  H.,  Repairable  Systems  Reliability,  Marcel  Dekker  (1984). 

Bartow,  R.  and  F.  Proschan,  Mathematicat  Theory  of  Reliability,  Wiley  (1965). 

Bazovsky,  I.,  Reliability  Theory  and  Practice,  Prentice  Hall  (1961). 

Billinton,  R.  and  Allan,  R.,  Reliability  Evahjation  of  Engineering  Systems:  Concepts 
and  Techniques,  Plenum  (1987). 

Fuqua,  N.,  Reliability  Engineering  for  Electronic  Design,  Dekker  (1987). 

Kececioglu,  D.,  Reliability  Engineering  Handbook,  Prentice  Hall  (1991). 

Klion,  J.,  Practical  Electronic  Reliability  Engineering,  Van  Nostrand  Reinhold 
(1992). 

Mann,  N.,  Schafer,  R.,  and  Singpurwalia,  N.,  Methods  for  Statistical  Analysis  of 
Reliability  and  Life  Data,  Wiley  (1974). 

Nelson,  W.,  App/Zed  Life  Data  Analysis,  Wiley  (1982). 

O'Connor,  P.,  Practical  Reliability  Engineering,  Wiley  (1991). 

Shooman,  M.,  Probabilistic  Reliability,  An  Engineering  Approach,  McGraw-Hill 
(1968). 

Siewiorek,  D.  and  Swarz,  R.,  The  Theory  and  Practice  of  Reliable  System  Design, 
Digital  Press  (1982). 


SAE  Annual  International  RMS 
Workshop 

Contact:  SAE  International 
400  Commonwealth  Dr 
Warrendale  PA  15096-0001 
(412)  776-4841 
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1 .0  Specifications,  Standards  and  Handbooks 

This  appendix  provides  a  summary  of  military  documents  related  to  the  R&M 
discipline.  Table  10-1  lists  reliability  standards  and  handbooks  along  with  an 
abbreviation  to  cross-reference  the  custodial  agencies  which  are  listed  in  Table  10- 
3.  Table  10-2  lists  maintainability  standards  and  handbooks  along  with 
abbreviations  of  custodial  agencies  which  are  listed  in  Table  10-3.  Table  10-4  lists 
other  R&M  related  standards,  specifications,  pamphlets  and  regulations. 
Department  of  Defense  Directives  and  Instructions  may  be  obtained  from  the 
National  Technical  Information  Service  at  the  address  shown  at  the  bottom  of  this 
page.  Copies  of  military  specifications,  standards  and  handbooks  may  be  ordered 
from: 

Standardization  Document  Order  Desk 
700  Robbins  Ave. 

Building  4,  Section  D 
Philadelphia.  PA  19111  -5094 
(215)  697-2667,  -2179 

2.0  Rome  Laboratory  Technical  Reports 

Table  10-5  summarizes  Rome  Laboratory  (formerly  RADC)  Technical  Reports 
related  to  R&M  design.  Documents  with  a  prefix  of  ”A*  in  the  AD  number  may  be 
ordered  by  the  general  public  from  the  National  Technical  Information  Center.  All 
others  are  available  to  DoD  contractors  from  the  Defense  Technical  Information 
Center. 


National  Technical  Information  Sen/ice 
(NTIS) 

Department  of  Commerce 
5285  Port  Royal  Road 
Springfield.  VA  22161-2171 
(703)  487-4650 


Defense  Technical  Information  Center 
DTIC-FDAC 

Cameron  Station,  Bldg.  5 
Alexandria,  VA  22304-6145 
(703)  274-7633  DSN:  284-7633 
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Table  10-1:  Reliability  Standards  and  Handbooks 
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Table  10-2:  Maintainability  Standards  and  Handbooks 
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Table  10-4:  Other  R&M  Related  Standards, 

Specifications,  Pamphlets  and  Regulations 

Document 

Date 

Title 

MIL-STD-454M 
Notice  3 

30  Oct  91 

Standard  General  Requirements  for  Electronic 
Equipment 

MIL-STD-883D 

16  Nov  91 

Test  Methods  and  Procedures  for  Microcircuits 

MIL-STD-965A 

13  Dec  85 

Parts  Control  Program 

MIL-STD-1309D 

12  Feb  92 

Definition  of  Terms  for  Testing  Measurement  and 
Diagnostics 

MIL-STD-138fi/1A 
Notice  3 

28  Mar  91 

Logistics  Support  Analysis 

MIL-STD-1388/2B 

28  Mar  90 

Logistics  Support  Analysis  Record,  DoD 
Requirements  for  a 

MIL-STD-1547A 

1  Dec  87 

Electronic  Parts,  Materials  and  Processes  for 

Space  and  Launch  Vehicles 

MIL-STD-1562W 

25  Sep  91 

List  of  Standard  MicrocircuKs 

MIL-BUL-103J 

31  Oct  91 

List  of  Standardized  Military  Drawings  (SMDs) 

MIL-STD-2165 

26  Jan  85 

Testability  Program  for  Electronic  Systems  and 
Equipment 

MIL-E-5400T 

14  May  90 

Electronic  Equipment,  Aerospace,  General 
Specification  for 

MIL-M-38510J 

15  Nov  91 

Microcircuits,  General  Specification  for 

MIL-H-38534 

22  Aug  90 

Hybrid  Microcircuits,  General  Specification  for 

MIL-I-38535A 

29  Nov  91 

Integrated  Circuits  (Microcircuits)  Manufacturing, 
General  Specification  for 

MIL-STD-1772B 

22  Aug  90 

Hybrid  Microcircuit,  General  Spe  rfication  for 

MIL-S-19500H 
Supplement  1 
Amendment  2 

30  Apr  90 

28  Sep  90 
30Jul  91 

Semiconductor  Devices,  General  Specification  for 
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Document 

Date 

Title 

ESD-TR-8S-148 

Mar  85 

Derating  Application  of  Parts  for  ESD  System 
Development 

RELI 

24  Apr  87 

DoD  Reliability  Standardization  Document  Program 
Plan,  Revision  4 

MNTY 

Dec  89 

DoD  Maintainability  Standardization  Document 
Program  Plan,  Revision  3 

MIL-HDBK-H108 

29  Apr  60 

Sampling  Procedures  and  Tables  for  Life  & 
Reli^lity  Testing  (Based  on  Exponential 
Distribution) 

MIL-HDBK-978B 

1  Sep  89 

NASA  Parts  Application  Handbook 

OoO  Dir.  5000.1 

23  Feb  91 

Defense  Acquisition 

DoD  Inst.  5000.2 

23  Feb  91 

Defense  Acquisition  Management  Policies  and 
Procedures 

MIL-STD-810E 
Notice  1 

9  Feb  90 

Environmental  Test  Methods  and  Engineering 
Guidelines 
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Table  10-5:  Rome  Laboratory  Reliability  &  Maintainability 
Technical  Reports 

RL-TR 

AO  No. 

Title 

RL-TR-92-95 
Apr  1992 

AOB1 64722 

Signal  Processing  Systems  Packaging  - 1 

RL-TR-92-96 
Apr  1992 

A8016S167 

Signal  Processing  Systems  Packaging  -  2 

RL-TR-91-29 
Mar  1991 

A0A233855 

A  Rome  Laboratory  Guide  to  Basic  Training  in  TQM 
Analysis  Techniques 

RL-TR-91-39 
Apr  1991 

A0A236S85 

Reliability  Design  for  Fault  Tolerant  Power  Supplies 

RL-7R-91-48 

AOA235354 

Measuring  the  Quality  of  Knowledge  Work 

RL-TR-91-87 
Apr  1991 

ADA236148 

A  Survey  of  Reliability,  Maintainability, 

Supportability,  and  Testability  Software  Tools 

RL-TR-91-121 

JUI1991 

ADB1 57688 

Electronic  Equipment  Readiness  Testing  Marginal 
Checking 

RL-TR-91-122 
Jun  1991 

ADB156175 

Reliability  Analysis  of  an  Ultra  Lightweight  Mirror 

RL-TR-9M55 

JUI1991 

ADA241476 

Computer  Aided  Assessment  of  Reliability  Using 

Finite  Element  Methods 

RL-TR-91-180 
Aug  1991 

ADA2418621 

Analysis  and  Demonstration  of  Diagnostic 
Performance  in  Modern  Electronic  Systems 

RL-TR-91-200 
Sept  1991 

ADA241865 

Automated  Testability  Decision  Tool 

RL-TR-91-220 
Sept  1991 

ADB1 59584 

Integration  of  Simulated  and  Measured  Vibration 
Response  of  Microelectronics 

RL-TR-91-251 
Oct  1991 

ADB160138 

Reliability  Assessment  of  Wafer  Scale  Integration 
Using  Finite  Element  Analysis 

RL-TR-91-300 
Nov  1991 

ADA245735 

Evaluation  of  Quantitative  Environmental  Stress 
Screening  (ESS)  Methods 

RL-TR-91-305 
Sept  1991 

ADA242594 

Total  Quality  Management  (TQM),  An  Overview 

RL-TR-91-353 
Dec  1991 

ADA247192 

SMART  BfT/TSMD  Integration 

RL-TR-91-402 
Dec  1991 

ADA251921 

MissionA^aintenance/Cycling  Effects  of  Reliability 
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RAOC-TR 

AO  No. 

TItio 

RADC-TR-90-31 

ADA222733 

A  Contractor  Program  Manager's  Testability 
Diagnostics  Guide 

RADC-TR-90-64 

AOA22132S 

Personal  Computer  (PC)  Thermal  Analyzer 

RADC-TR-90-72 

ADA223647 

Reliability  Analysis  Assessment  of  Advanced 
Technologies 

RADC-TR-90-109 
Vol.  1 

Vol.  II 

ADA226902 

ADA226820 

Integration  of  Sneak  Analysis  with  Design 

RADC-TR-90-120 

ADA226820 

Relia^lity/Maintainability/Logistics  Support 
Analysis  Computer  Aided  Tailoring  Software 
Program  (R/M/L  CATSOP) 

RADC-TR-90-239 

AOA230067 

Testability/Diagnostics  Design  Encyclopedia 

RAOC-TR-90-269 

ADB150948 

Quantitative  Reliability  Growth  Factors  for  ESS 

RADC-TR-89-4S 

ADA208917 

A  Government  Program  Manager's 
Tests^ility/Diagnostics  Guide 

RADC-TR-89-160 

A0B138156L 

Environmental  Extreme  Recorder 

RADC-TR-89-165 

ADA215298 

RADC  Fault  Tolerant  System  Reliability  Evaluation 
Facility 

RADC-7R-89-209 
Vol.  1 

Vol.  II 

Vol.  Ill 

ADA215737 

ADA215738 

ADA215739 

Computer-Aided  Design  for  Built-in-Test 
(CADBIT)  -  Technical  Issues 
(CADBfT)- BIT  Library 
(CADBIT)  -  Software  Specification 

RADC-TR-89-223 

ADA21527S 

Sneak  Circuit  Analysis  for  the  Common  Man 

RADC-TR-89-276 

ADB140924L 

Dormant  Missile  Test  Effectiveness 

RADC-TR-89-277 

ADB141826L 

SMART  BrT-2 

RADC-TR-89-281 

ADA216907 

Reliabiiity  Assessment  Using  Finite  Element 
Techniques 

RADC-7R-89-299 
Vol.  1 

Vol.  II 

ADB141960L 

ADB141961L 

Reliability  and  Maintainabilrty  Operational 
Parameter  Translation  II 

RADC-TR-89-363 

ADA219941 

FASTER:  The  Fault  Tolerant  Architecture 
Simulation  Tool  for  Evaluating  Reliability, 
Introduction  and  Application 
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RADC-TR 

AD  No. 

Titio 

RADC-TR-88-13 

ADB122629L 

VHSiC  Impact  on  System  Reliability 

RAOC-TR-88-69 

Vol.  1 

Vol.  II 

ADA200204 

ADA215531 

R/M/T  Design  for  Fault  Tolerance.  Program 
Manager's  Guide 

R/M/T  Design  for  FauK  Tolerance,  Design 
Implementation  Guide 

RADC-TR-88-72 

ADA1 93759 

Reliability  Assessment  of  Surface  Mount 
Technology 

RADC-TR-88-97 

ADA200529 

Reliability  Prediction  Models  for  Discrete 
Semiconductor  Devices 

RADC-TR-ea-IIO 

ADA202704 

Reliability/Maintainability/Testabiiity  Design  for 
Dormancy 

RADC-TR-88-118 

ADA201346 

Operational  and  Logistics  Impact  on  System 
Readiness 

RADC-TR-88-124 

AOA201946 

Impact  of  Fiber  Optics  on  System 
Reliability/Maintainability 

RADC-TR-88-124 

ADA201946 

Impact  of  Fiber  Optics  on  System 
Reliability/Maintainability 

RADC-TR-88-211 

ADA205346 

Testability/Diagnostics  Encyclopedia  Program 
(Part  1) 

RADC-TR-88-304 
Vol.  1.  Part  A 

Vol.  II,  Part  B 

ADB132720L 
ADB1 32721 L 

Reliability  Design  Criteria  for  High  Power  Tubes 
Review  ol  Tube  and  Tube  Related  Technology 

RADC-TM-87-11 

ADA1 89472 

Availability  Equations  For  Redundant  Systems, 

Both  Single  and  Multiple  Repair 

RADC-TR-87-13 

ADB119216L 

Maintenance  Concepts  for  VHSIC 

RADC-TR-87-55 

ADA183142 

Predictors  of  Organizational-Level  Testability 
Attributes 

RADC-TR-87-92 

ADB117765L 

Large  Scale  Memory  Error  Detection  and  Correction 

RADC-TR-87-177 

A0A1 89488 

Reliability  Analyses  of  a  Surface  Mounted  Package 
Using  Finite  Element  Simulation 

RADC-TR-87-  225 

ADA1 93788 

Improved  Readiness  Thru  Environmental  Stress 
Screening 
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RAOC-TR 

AD  No. 

TItIO 

RADC-TR-86-138 

ADA1 74333 

RADC  Guide  to  Environmental  Stress  Screening 

RADC*TR-86-148 

A0A176128 

Reliability  Growth  Prediction 

RADC-TR-86-149 

ADA1 76847 

Environmental  Stress  Screening 

RADC-TR-86-195 
Vot.  1 

Vol.  II 

ADB1 10761 
AOB1 1 1438L 

Toots  For  Integrated  Diagnostics 

RADC-TR-86-241 

ADA1 82335 

Built-In-Test  Verification  Techniques 

RADc-TR-as-ee 

ADA1 57242 

Study  and  Investigation  to  Update  the 
Nonelectronic  Reliability  Notebook 

RADC-TR-85-91 

A0A1 58843 

Impact  of  Nonoperating  Periods  on  Equipment 
Reliability 

RADC-TR-85-148 

ADB098377L 

Smart  BIT 

RADC-TR-85-150 

ADA162617 

A  Ratbnale  and  Approach  for  Defining  and 
Structuring  Testability  Requirements 

RADC-TR-85-194 

ADA1 63900 

RADC  Nonelectronic  Reliability  Notebook 

RADC-TR-85-228 
Vol.  I 

Vol.  II 

ADA1 65231 

ADA  165232 

Impact  of  Hardware/Software  FauKs  on  System 
Reliability  -  Study  Results 

Procedures  for  Use  of  Methodology 

RADC-TR-85-229 

ADA1 64747 

Reliability  Prediction  for  Spacecraft 

RADC-TR-85-268 

ADA1 67959 

Prediction  and  Analysis  of  Testability  Attributes: 
Organizational  Level  Testability  Prediction 

RL-TR-84-20 

ADA141232 

Reliability  Growth  Testing  Effectiveness 

RADC-TR-84-25 

Vol.  I 

Vol.  II 

ADB087426 

ADB087507L 

Reliability/Maintainability  Operational  Parameter 
Translation 

RADC-TR-84-83 

ADA1 45971 

Ballpark  Reliability  Estimation  Techniques 

RADC-TR-84-100 

ADB086478L 

Thermal  Stress  Analysis  of  Integrated  Circuits 
Using  Finite  Element  Methods 
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RADC-TR 

AD  No. 

Titio 

RAOC-TR-84-165 

ADA1 49684 

Maintainability  Tima  Standarda  for  Electronic 
Equipment 

RAOC-TR-84-182 

AO  A1 53268 

VLSI  Device  Reliability  Models 

RADC-TR-84'203 

ADA150694 

Artificial  Intelligence  Applications  to  Testability 

RADC-'m-84-244 

ADA154161 

Automated  FMEA  Tachniquas 

RAOC-TR-84-2S4 

ADA1 53744 

Reliability  Derating  Procedures 

RADC-TR-84-268 

ADA1 53761 

Prediction  of  Scheduled  and  Preventive 
Maintenance  Workload 

RADC-TR-83-2 

ADA1 27546 

Study  of  Causes  of  Unnecessary  Removals  of 
Avionic  Equipment 

RADC-TR-83-4 

ADA126167 

Analytical  Procedures  for  Testability 

RADC-TR-83-13 

ADB075924L 

Testability  Task  Traceability 

RADC-TR-83-29 

Vol.  1 

Vol.  II 

A0A1 29596 
AOA129597 

Reliability,  Maintainability  and  Life  Cycle  Costs 
Effects  of  Using  Commerdal-Off-the-Shelf 
Equipment 

RADC-TF-33-36 

A0A1 29438 

Fault  Tolerance,  Reliability  and  Testability  of 
Distr^Hited  Systems 

RADC-TR-83-49 

ADA1 30465 

Guide  to  Government  Reliability,  Maintainability  and 
Quality  Assurance  Organizations 

RADC-TR-83-72 

A0A13158 

The  Evolution  and  Practical  Applications  of  Failure 
Modes  and  Effects  Analyses 

RADC-TR-83-85 

Vol.  1 

Vol.  II 

ADA133624 
ADA1 33625 

Reliability  Programs  for  Nonelectronic  Parts 

RADC-7R-83-108 

ADA1 35705 

Reliability  Modeling  of  Critical  Electronic  Devices 

RADC-TR-83-172 

ADB077240L 

ORACLE  and  Predictor  Computerized  Reliability 
Prediction  Programs 

RADC-TR-83-180 

ADA1 38576 

Condition  Monitoring  Techniques  for 
Electromechanical  Equipment  Used  in  AF  Ground 
C^l  Systems 

RADC-7R-83-257 

A0A149683 

Computer  Aided  Testability  Design  Analysis 
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RADC-TR _ AD  No. _ Titlj _ 

RADC-TR-83-291  AOA1 41 1 47  Advancsd  Applications  of  the  Printed  Circuit  Board 

Testability  Design  artd  Rating  System 

RAOC-TR-63-316  ADB083630L  Hardware/Software  Tradeoffs  for  Test  Systems 

RADC-TR-82-1 72  ADA1 1 8839  RAOC  Thermal  Guide  for  Reliablity  Engineers 

RADC-TR-82-179  ADA1 18479  Sneak  Analysis  Application  Guidelines 

RAOC-TR-81-106  ADA108150  'Bayesian*  Reliability  Tests  Made  Practical 

RAOC-TR-80-30  ADA083009  Bayesian  Reliability  Theory  for  Repairable 

Equipment 

RADC-TR-79-200  ADA073299  Reliability  and  Maintainability  Management  Manual 
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n 

Repair  Rata  (1/Mean- 

Correctiva-Maintenance 

Tima) 

X. 

Failure  Rata  (1/Mean-Time- 
Batwaan-Failura) 

a 

Producer’s  Risk 

Consumar's  Risk 

®c-a 

Case  to  Ambient  Thermal 
Resistance 

®i-c 

Junction  to  Case  Thermal 
Resistance 

®i-a 

Junction  to  Ambient 

Thermal  Resistance 

A 

0 

Observed  Point  Estimate 
Mean-Time-Between-Failura 

00 

Upper  Test  (Design  Goal) 
Mean-Time-Between -Failure 

«1 

Lower  Test  (Unacceptable) 
Mean-Time- Between-Failure 

0p 

Predicted  Mean-Time- 
Between-Failure 

Ai 

Inherent  Availability 

Ao 

Operatfonai  Availability 

AAA 

Allocations  Assessment 
and  Analysis  (Report) 

A<X) 

Administrative  Contracting 
Officer 

ADAS 

Architecture  Design  and 
Assessment  Systems 

ADM 

Advanced  Development 
Model 

ADP 

Automatic  Data  Processing 

ADPE 

Automatic  Data  Processing 
Equipment 

AFAE 

Air  Force  Acquisition 
Executive 

AFALC 

Air  Force  Acquisition 
Logistics  Centers 

AFCC 

Air  Force  Communication 
Command 

AFFTC 

Air  Force  Flight  Test  Center 

AFLC 

Air  Force  Logistics 

Command 

AFMC 

Air  Force  Materiel  Command 

AFOTEC 

Air  Force  Operational  Tost 
and  Evaluation  Center 

AFPRO 

Air  Force  Plant 
Representative  Office 

AFR 

Air  Force  Regulation 

AFSC 

Air  Force  Systems 
Command 

AFTO 

Air  Force  Technical  Order 

AGS 

Ambiguity  Group  Size 

AI 

Artificial  Intelligence 

AJ 

Antijam 

ALC 

Air  Logistics  Center 

ALU 

Arithmetic  Logic  Unit 

AMGS 

Automatic  Microcode 
Generation  System 

AMSDL 

Acquisition  Management 
Systems  and  Data  Control 
List 

AP 

Array  Processor 

APD 

Avalanche  Photo  Diode 

APTE 

Automatic  Programmed 

Test  Equipment 

APU 

Auxiliary  Power  Unit 

ARM 

Antiradiation  Missile 

ASA 

Advanced  Systems 
Architecture 

ASC 

Aeronautical  Systems 
Center 

ASIC 

Application  Specific 
Integrated  Circuit 

ASTM 

American  Society  for 

Testing  and  Materials 

ATC 

Air  Training  Command 

ATE 

Automatic/Automated  Test 
Equipment 

ATF 

Advanced  Tactical  Fighter 

ATG 

Automatic  Test  Generation 

ATP 

Acceptance  Test  Procedure 

ATTO 

Advanced  Technology 
Transition  Demonstration 

AViP 

Avionics  Integrity  Program 

b 

BIT 

BAFO 

Best  and  Final  Offer 

BB,  B/B 

Brass  Board 

BCC 

Block  Check-Sum 

Character 

BCS 

Bench  Check  Serviceable 

BCWP 

Budget  Cost  of  Work 
Performed 
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BCWS 

Budget  Cost  of  Work 
Scheduled 

BEA 

Budget  Estimate  Agreement 

BES 

Budget  Estimate 

Submission 

BIMOS 

Bipolar/Metal  Oxide 
Semiconductor 

BIST 

Built-in  Self  Test 

BIT 

Built-In-Test 

BITE 

BuiK-ln-Test  Equipment 

BIU 

Bus  Interface  Unit 

BJT 

Bipolar  Junction  Transistor 

BLER 

Block  Error  Rate 

BPPBS 

Biennial  Planning, 
Programming,  and 

Budgeting  System 

B/S  or  bps 

Bits  Par  Second 

C 

Centigrade 

GROM 

Control  Read  Only  Memory 

C3 

Command,  Control  and 
Communications 

C^CM 

Command.  Control, 
Communications  and 
Countermeasures 

C3| 

Command,  Control, 
Communications 

Intelligence 

CA 

Contracting  Activity 

CAD 

Computer  Aided  Design 

CADBIT 

Computer  Aided  Design  for 
Built-In  Test 

CAE 

Computer  Aided 

Engineering 

CALS 

Computer  Aided  Acquisition 
Logistics  &  Support 

CAM 

Content  Addressable 

Memory 

CAS 

Column  Address  Strobe 

CASS 

Computer  Aided  Schematic 
System 

CAT 

Computer  Aided  Test 

CB 

Chip  Boundary 

CCB 

Capacitive  Coupled  Bit 

CCB 

Configuration  Control  Board 

CCC 

Ceramic  Chip  Cam'er 

CCD 

Charged  Coupled  Device 

COF 

Cumulative  Density 

Function 

CDIP 

Ceramic  Dual  In-Line 
Package 

CDR 

Critical  Design  Review 

CDRL 

Contract  Data 

Requirements  List 

CFAR 

Constant  False  Alarm  Rate 

CFE 

Contractor  Furnished 
Equipment 

CFSR 

Contract  Fund  Status 

Report 

CGA 

Configurable  Gate  Array 

Cl 

Configuration  Kern 

CIM 

Computer  Integrated 
Manufacturing 

CINC 

Commander-in-Chief 

CISC 

Complex  Instruction  Set 
Computer 

CIU 

Control  Interface  Unit 

CLCC 

Ceramic  Leaded  Chip 

Carrier 

CLIN 

Contract  Line  Item  Number 

CM 

Centimeter 

CM 

Configuration  Manager  or 
Management 

CML 

Current  Mode  Logic 

CMOS 

Complementary  Metal  Oxide 
Semiconductor 

CND 

Can  Not  Duplicate 

CNI 

Communications, 

Navigation,  and 

Identification 

CO 

Contracting  Officer 

CODEC 

Coder  Decoder 

COMM 

Communications 

COMSEC 

Communications  Security 

COPS 

Complex  Operations  Per 
Second 

CPCI 

Computer  Program 
Configuration  Kern 

CPFF 

Cost-Plus-Fixed-Fee 

CPIF 

Cost-Plus-Incentive-Fee 

CPM 

Control  Processor  Module 

CPU 

Central  Processing  Unit 

CRC 

Cyclic  Redundance  Check 

CS 

Chip  Select 

CSC 

Computer  Software 
Component 
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CSCI 

Computer  Software 
Configuration  Item 

CSP 

Common  Signal  Processor 

CSR 

Control  Status  Register 

CTE 

Coefficient  of  Thermal 
Expansion 

cm 

Current  Transfer  Ratio 

cv 

Capacitance- Volt  age 

dB 

Decibel 

dc 

Direct  Current 

D/A 

Digital-to-Analog 

DAB 

Defense  Acquisition  Board 

DC 

Duty  Cycle 

DECTED 

Double  Error  Correcting, 
Triple  Error  Detecting 

DED 

Double  Error  Detection 

DEMA/AL 

Demonstration  and 
Validation 

DESC 

Defense  Electronics  Supply 
Center 

DID 

Data  Item  Description 

DIP 

Dual  In-Line  Package 

DISC 

Defense  Industrial  Supply 
Center 

DLA 

Defense  Logistics  Agency 

D  Level 

Depot  Level 

DID 

Data  hern  Description 

D^R 

Defense  Management 
Review 

DCX5 

Department  of  Defense 

DOS 

Disk  Operating  System 

DOX 

Design  of  Experiments 

DP 

Data  Processor 

DPA 

Destructive  Physical 
Analysis 

DRAM 

Dynamic  Random  Access 
Memory 

DRS 

Deficiency  Reporting 

System 

DSP 

Digital  Signal  Processing 

DT&E 

Development  Test  & 
Evaluation 

DTIC 

Defense  Technical 
Information  Center 

DUT 

Device  Under  Test 

DoD 

Department  of  Defense 

DoD-ADL 

Department  of  Defense 
Authorized  Data  List 

eV 

Electron  Volt 

Ea 

Activation  Energy  in 
Electron  Volts 

Eox 

Electronic  Field  Strength  in 
Oxide 

EAROM 

Electrically  Alterable  Read 
Only  Memory 

ECC 

Error  Checking  and 
Correction 

ECCM 

Electronic  Counter 
Countermeasures 

ECL 

Emitter  Coupled  Logic 

ECM 

Electronic 

Countermeasures 

ECP 

Engineering  Change 
Proposal 

ECU 

Environmental  Control  Unit 

EDA 

Electronic  Design 
Automation 

EDAC 

Error  Detection  and 
Correction 

EDM 

Engineering  Development 
Model 

EEPROM 

Electrically  Erasable 
Programmable  Read  Only 
Memory 

EGC 

Electronic  Gate  Count 

EGS 

Electronic  Ground  System 

EGSE 

Electronic  Ground  Support 
Equipment 

EM 

Electromigration 

EMC 

Electromagnetic 

Compatibility 

EMD 

Engineering  and 
Manufacturing  Devetopment 

EMI 

Electromagnetic  Interface 

EMP 

Electronic  Magnetic  Pulse 

EO 

Electro-optical 

EOS 

Electrical  Overstress 

EP 

Electrical  Parameter 

EPROM 

Erasable  Programmable 
Read  Only  Memory 

ER  Part 

Established  Reliability  Part 

ERC 

Electrical  Rule  Check 

ESC 

Electronic  System  Center 

ESD 

Electrostatic  Discharge 

ESM 

Electronics  Support 

Measure 
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ESS 

Environmental  Stress 
Screening 

ETE 

Electronic  or  External  Test 
Equipment 

EW 

Electronic  Warfare 

EXP 

Exponent 

FA 

False  Alarm 

F/W 

Firmware 

FAB 

Fabrication 

FAR 

False  Alarm  Rate 

FAR 

Federal  Acquisition 
Regulation 

FARR 

Forward  Area  Alerting  Radar 
Racehrer 

FAT 

First  Article  Testing 

FBT 

Functional  Board  Test 

FCA 

Functional  Configuration 
Audit 

R) 

Fault  Detection 

FDI 

Fault  Detection  and 

Isolation 

FET 

Field  Effect  Transistor 

FFD 

Fraction  of  Faults  Detected 

FFI 

Fraction  of  Faults  Isolated 

FFP 

Firm  Fixed  Pr'ce 

FFRP 

Field  Failure  Return  Program 

FFT 

Fast  Fourier  Transform 

FFTAU 

Fast  Fourier  Transform 
Arithmetic  Unit 

FFTOJ 

Fast  Fourier  Transform 
Control  Unit 

FI 

Fault  Isolation 

FIFO 

Rrst  In  First  Out 

FILO 

First  In  Last  Out 

FIR 

Fault  Isolation  Resolution 

FITS 

Failure  Per  10®  Hours 

FIT 

Fault  Isolation  Test 

FLIR 

Forward  Looking  Infrared 

FLOTOX 

Floating  Gate  Tunnel  - 
Oxide 

FMC 

Full  Mission  Capability 

FMEA 

Failure  Modes  and  Effects 
Analysis 

FMECA 

Failure  Modes,  Effects  and 
Criticality  Analysis 

FOM 

Figure  of  Merit 

FOV 

Field  of  View 

FP 

Floating  Point 

FPA 

Focal  Plane  Array 

FPAP 

Floating  Point  Array 
Processor 

FPLA 

Field  Programmable  Logic 
Array 

FPMFH 

Failure  Per  Million  Flight 
Hours 

FPMH 

Failures  Per  Million  Hours 

FPPE 

Floating  Point  Processing 
Element 

FOR 

Formal  Qualification  Review 

FQT 

Final  QualHicatbn  Test 

m 

Failure  Rate 

FRACAS 

Failure  Reporting  and 
Corrective  Action  System 

FRB 

Failure  Review  Board 

FS 

Fun  Scale 

FSD 

Full  Scale  Development 

FSED 

Full  Scale  Engineering 
Development 

FT 

Fourier  Transform 

FTTL 

Fast  Transistor  •  Transistor 
Logic 

FY 

Fiscal  Year 

GAO 

General  Accounting  Office 

GD 

Global  Defect 

GFE 

Government  Furnished 
Equipment 

GFP 

Government  Furnished 
Property 

GIDEP 

Government  Industry  Data 
Exchange  Program 

GIMADS 

Generic  Integrated 
Maintenance  Diagnostic 

CM 

Global  Memory 

GOCO 

Government  Owned 
Contractor  Operated 

GOMAC 

Government  Microcircuit 
Applications  Conference 

GSE 

Ground  Support  Equipment 

GSPA 

Generic  Signal  Processor 
Architecture 

GaAs 

Gallium  Arsenide 

Hz 

Hertz 

HDL 

Hardware  Description 
Language 

WS 

Hierarchical  Design  System 

HEMT 

High  Electron  Mobility 
Transistor 
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HFTA 

Hardware  Fault  Tree 
Analysis 

HHDL 

Hierarchical  Hardware 
Description  Language 

HM06 

High  Performance  Metal 
Oxide  Semiconductor 

HOL 

Higher  Order  Language 

fiW 

Hardware 

HWCI 

Hardware  Configuration 

Item 

1 

Current 

Id 

Drain  Current 

Isub 

Substrate  Current 

ID 

Integrated  Diagnostics 

IF 

Interface 

lAC 

Information  Analysis  Center 

lAW 

In  Accordance  With 

1C 

Integrated  Circuit 

ICD 

Interface  Control  Document 

ICNIA 

Integrated 

Communications, 

Navigation  and 

Identification  Avionics 

ICT 

In  Circuit  Testing 

ICWG 

Interface  Control  Working 
Group 

IDAS 

Integrated  Design 
Automation  System 

IDHS 

Intelligence  Data  Handling 
System 

IEEE 

Institute  of  Electrical  and 
Electronic  Engineers 

lES 

Institute  of  Environmental 
Sciencies 

IFB 

Invitation  for  Bid 

IFF 

Identification  Friend  or  Foe 

IFFT 

Inverse  Fast  Fourier 
Transform 

IG 

Inspector  General 

1  Level 

Intermediate  Level 

ILD 

Injection  Laser  Diode 

ILS 

Integrated  Logistics 

Support 

ILSM 

Integrated  Logistics 

Support  Manager 

IMPATT 

Impact  Avalanche  and 
Transit  Time 

INEWS 

Integrated  Electronic 
Warfare  System 

I/O 

Input/Output 

IOC 

Initial  Operational  Capability 

KDT&E 

Initial  Operational  Test  & 
Evaluation 

IR&D 

Independent  Research  & 
Developmant 

IRPS 

International  Reliability 
Physics  Symposium 

ISA 

Instruction  Set  Architecture 

ISPS 

Instruction  Set  Processor 
Specification 

ITAR 

International  Traffic  In  Arms 
Regulation 

ITM 

Integrated  Test  and 
Maintenance 

IWSM 

Integrated  Weapons 
Systems  Management 

J 

Current  Density 

JAN 

Joint  Army  Navy 

JCS 

Joint  Chiefs  of  Staff 

JEDEC 

Joint  Electron  Device 
Engineering  Council 

JFET 

Junction  Field  Effect 
Transistor 

JTAG 

Joint  Test  Action  Group 

K 

Thousand 

k 

Boltzman's  Constant  (8.65 

X 10'®  electron 
volts/®Kelvin) 

KOPS 

Thousands  of  Operations 
Per  Second 

LAN 

Local  Area  Network 

LCC 

Life  Cycle  Cost 

LCC 

Leadless  Chip  Carrier 

LCCC 

Leadless  Ceramic  Chip 
Carrier 

LED 

Light  Emitting  Diokfe 

LFR 

Launch  and  Flight  Reliability 

LHR 

Low  Hop  Rate 

LIF 

Low  Insertion  Force 

LIFO 

Last  In  First  Out 

LISP 

List  Processing 

LRM 

Line  Replaceable  Module 

LRU 

Line  Replaceable  Unit 

LSA 

Logistics  Support  Analysis 

LSAR 

Logistics  Support  Analysis 
Record 

LSB 

Least  Significant  Bit 
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LSE 

LSI 

LSSD 

Lsm 

LUT 

mm 

mA 

ms 

mW 

M 

m 

Mb 

Met 

Mil 

M-MM 

MAC 

MAJCOM 

MAP 

MBPS 

MCCR 

MCFOS 

MCOPS 

MCTL 

MCU 

MD 

MDCS 

M3M 

MDR 

MDT 

MELF 

MENS 

MENS 

MFLOPS 

MHz 


Lead  System  Engineer 
Large  Scale  Integration 
Level  Sensitive  Scan 
Design 

Low  Power  Schottky 

Transistor  Transistor  Logic 

Look  Up  Table 

Millimeter 

Milliampere 

Millisecond 

Milliwatt 

Maintainability 

Million 

Megabit 

Mean  Corrective 
Maintenance  Time 
1000th  of  an  Inch 
Mean  Maintenance 
Manhours 

Multiplier  Accumulator  Chip 
Major  Command 
Modular  Avionics  Package 
Million  Bits  Per  Second 
Mission  Critical  Computer 
Resources 

Military  Computer  Family 
Operating  System 
Million  Complex  Operations 
Per  Second 

Military  Critical  Technology 
List 

Microcontrol  Unit 
Maintainability 
Demonstration 
Maintenance  Data 
Collection  System 
Multiplexer/Demultiplexer 
Microcircuit  Device 
Reliability 
Mean  Down  Time 
Metal  Electrode  Face 
Mission  Element  Needs 
Statement 

Mission  Equipment  Needs 

Statement 

Million  Floating  Point 

Operations  Per  Second 

Megahertz 


MIL-STD 

MIMIC 

MIN 

MIPS 

MISD 

MLB 

MLIPS 


MMBF 

MM) 

MMH/FH 

MMH/PH 

MMIC 

MMM 

MMPS 

MMR 

MMS 

MMW 

h/NH 

MNS 

MOA 

MODEM 

MOPS 

MOS 

MOSFET 

MP 

MPCAG 

MRAP 

MSB 

MSI 

MTBCF 

MTBD 

MTBDE 


Military  Standard 
Microwave  Millimeter  Wave 
Monolithic  Integrated  Circuit 
Maintenance  Interface 
Network 

Million  Instructions  Per 
Second 

Multiple  Instructions  Single 
Data 

Multilayer  Board 
Millnn  Logic 

Inferences/Instructions  Per 
Second 

Mean  Miles  Between  Failure 
Mean  Mission  Duratbn 
Maintenance  Manhours  Per 
Right  Hour 
Mean  Manhours  Per 
Possessed  Hour 
Monolithic  Microwave 
Integrated  Circuit 
Mass  Memory  Module 
Million  Multiples  Per  Second 
Multimode  Radar 
Mass  Memory  Superchip 
Millimeter  Wave 
Maintenance  Node 
Maintenance  Network  Node 
Mission  Need  Statement 
Memorandum  of  Agreement 
Modulator  Demodulator 
Million  Operations  P 
Second 

Metal  Oxide  Semicon^  r 
Metal  Oxide  Semiconc 
Field  Effect  Transistor 
Maintenance  Processor 
Military  Parts  Control 
Advisory  Group 
Microcircuit  Reliability 
Assessment  Program 
Most  Significant  Bit 
Medium  Scale  Integration 
Mean  Time  Between  Cr’ttical 
Failures 

Mean  Time  Between 
Demand 

Mean  Time  Between 
Downing  Events 
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MTBF 

Mean  Time  Between  Failure 

MTBFF 

Mean  Tima  Between 
Functbnal  Failure 

MTBM-IND 

Mean  Time  Between 
Maintenance-Induced  (Type 
2  Failure) 

MTBM-INH 

Mean  Time  Between 
Maintenance-Inherent 
(Type  1  Failure) 

MTBM-ND 

Mean  Time  Between 
Maintenanca-No  Defect 
(Type  6  failure) 

MTBM-P 

Mean  Time  Between 
Maintenance-Preventive 

MTBM-TOT 

Mean  Time  Between 
Maintenance-Total 

MTBMA 

Mean  Time  Between 
Maintenance  Actions 

MTBR 

Mean  Time  Between 
Removals 

MTBUMA 

Mean  Time  Between 
Unscheduled  Maintenance 
Actions 

MTE 

Multipurpose  Test 

Equipment 

MTE 

Minimal  Test  Equipment 

MTI 

Moving  Target  Indicator 

Ml  It 

Mean  Time  to  Error 

Ml  11- 

Mean  Time  To  Failure 

MUX 

Multiplexer 

MV 

Mega  Volt  (Million  Volt) 

MWPS 

Million  Words  Per  Second 

NDI 

Nondevelopmental  Items 

NOT 

Nondestructive  Testing 

NMOS 

N-Channel  Metal  Oxide 
Semiconductor 

ns 

Nanosecond 

O-Level 

Organizational  Level 

O&M 

Operation  and  Maintenance 

0MB 

Office  of  Management  and 
Budget 

OPR 

Office  of  Primary 
Responsibility 

OPS 

Operations  Per  Second 

ORD 

Operational  Requirements 
Document 

OROM 

Optical  Read  Only  Memory 

OSD 

Office  of  the  Secretary  of 
Defense 

OT&E 

Operational  Test  & 
Evaluation 

OTS 

Off-The-Shelf 

P 

Power 

Poly 

Polycrystalline  Silicon 

PtSi 

Platinum  Silicide 

PAL 

Programmable  Array  Logic 

PAT 

Programmable  Alarm 
Thresholds 

PC 

Printed  Circuit 

PCA 

Physical  Configuration 

Audit 

PCB 

Printed  Circuit  Board 

PCO 

Procuring  Contracting 
Officer 

PD 

Power  Dissipation 

PDF 

Probability  Density  Function 

PDL 

Program  Design  Language 

PDR 

Preliminary  Design  Review 

PEM 

Program  Element  Monitor 

PGA 

Pin  Grid  Array 

PIN 

Positive  Intrinsic  Negative 

PLA 

Programmable  Logic  Array 

PLCC 

Plastic  Leadless  Chip 

Carrier 

PLD 

Programmable  Logic  Device 

PM 

Program  Manager 

PMD 

Program  Management 
Directive 

PMOS 

P-Channel  Metal  Oxide 
Semiconductor 

PMP 

Program  Management  Plan 

PMP 

Parts,  Materials  and 
Processes 

PMR 

Program  Management 
Review 

PMRT 

Program  Management 
Responsibility  Transfer 

PPM 

Parts  Per  Million 

PPSL 

Preferred  Parts  Selection 

List 

PO 

Program  Office 

PROM 

Programmable  Read  Only 
Memory 

PRR 

Production  Readiness 
Review 

PRST 

Probability  Ratio  Sequential 
Test 
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PS 

Power  Supply 

PTH 

Plated  Through  Hole 

PW 

Pulse  Width 

PWB 

Printed  Wiring  Board 

QA 

Quality  Assurance 

QC 

Quality  Control 

QOR 

Quality  Deficiency  Report 

QML 

Qualified  Manufacturers 

List 

QPL 

Qualified  Parts  List 

QT&E 

Qualification  Test  and 
Evaluation 

QUMR 

Quality  Unsatisfactory 
Material  Report 

R 

Reliability 

R&M 

Reliability  and 
Maintainability 

RAD 

Radiation 

RAM 

Random  Access  Memory 

RAMS 

Reliability  and 

Maintainability  Symposium 

RD 

Random  Defect 

RDGO 

Reliability  Development 
Growth  Test 

RDT 

Reliability  Demonstration 
Test 

REG 

Register 

RF 

Radio  Frequency 

RFP 

Request  for  Proposal 

RH 

Relative  Humidity 

RISA 

Reduced  Instruction  Set 
Architecture 

RISC 

Reduced  Instruction  Set 
Computer 

RIW 

Reliability  Improvement 
Warranty 

RL 

Rome  Laboratory 

RMS 

Root  Mean  Square 

ROC 

Required  Operational 
Capability 

ROM 

Read  Only  Memory 

ROM 

Rough  Order  of  Magnitude 

ROT 

Reliability  Qualification  Test 

RSA 

Rapid  Simulation  Aids 

RSR 

Runtime  Status  Register 

RTL 

Register  Transfer  Language 

RTOK 

Retest  Okay 

RTQC 

Real  Time  Quality  Control 

SAF 

Secretary  of  the  Air  Force 

SAR 

Synthetic  Aperture  Radar 

SAW 

Surface  Acoustic  Wave 

SBIR 

Small  Business  Innovative 
Research 

SC 

Space  Center 

SCA 

Sneak  Circuit  Analysis 

SCARLET 

Sneak  Circuit  Analysis 
Rome  Laboratory 
Engineering  Tool 

SCD 

Specification  Control 
Drawing 

SCR 

Silicon  Control  Rectifier 

SDI 

Strategic  Defense  Initiative 

SDL 

System  Desaiption 
Language 

SDR 

System  Design  Review 

SDS 

Structured  Design  System 

SE 

Support  Equipment 

SECDED 

Single  Error  Correction, 
Double  Error  Detectnn 

SECDEF 

Secretary  of  Defense 

SED 

Single  Error  Detectnn 

SEDS 

System  Engineering 
Detailed  Schedule 

SEM 

Standard  Electronic  Module 

SEMP 

Systems  Engineering 
Management  Plan 

SER 

Soft  Error  Rate 

SERD 

Support  Equipment 
Recommended  Data 

SEU 

Single  Event  Upset 

SIP 

Single  In-Line  Package 

SMD 

Standard  Military  Drawing 

SMD 

Surface  Mounted  Device 

SMT 

Surface  Mounted 
Technology 

S/N 

Signal  to  Noise  Ratio 

SOA 

Safe  Operating  Area 

SOI 

Silicon  On  Insulator 

SOIC 

Small  Outline  Integrated 
Circuit 

SON 

Statement  of  Need 

SORD 

Systems  Operational 
Requirements  Document 

SOS 

Silicon  On  Sapphire 

SOW 

Statement  of  Work 

SPAD 

Scratch  Pad  Memory 
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SPC 

Statistical  Process  Control 

SPO 

System  Program  Office 

sex: 

Statistical  Quality  Control 

SR 

Slew  Rate 

SRA 

Shop  Replaceable 
Assembly 

SRD 

System  Requirement 
Document 

SRAM 

Static  Random  Access 
Memory 

SRAP 

Semiconductor  Reliability 
Assessment  Program 

SRL 

Shift  Register  Latch 

SRR 

Systems  Requirement 
Review 

SRU 

Shop  Replaceable  Unit 

SSA 

Source  Selection  Authority 

SSAC 

Source  Selection  Advisory 
Council 

SSEB 

Source  Selections 
Evaluation  Board 

SSI 

Small  Scale  Integration 

SSP 

Source  Selection  Plan 

SSPA 

Submicron  Signal 
Processor  Architecture 

SSR 

Software  Specification 
Review 

ST 

Self  Test 

STD 

Standard 

STE 

Special  Test  Equipment 

STINFO 

Scientific  and  Technical 
Information 

STV 

Steerable  Television  Set 

S/W 

Software 

t 

Time 

T 

Temperature 

Ta 

Ambient  Temperature 

Tc 

Case  Temperature 

Tj 

Junction  Temperature 

Tstg 

Storage  Temperature 

TAG 

Tactical  Air  Command 

TBD 

To  Be  Determined 

TC 

Temperature  Coefficient 

TCE 

Thermal  Coefficient  of 
Expansion 

TCR 

Temperature  Coefficient  of 
Resistance 

TDOB 

Time  Dependent  Dielectric 
Breakdown 

TDM 

Time  Division  Multiplexing 

T&E 

Test  and  Evaluation 

TEMP 

Test  &  Evaluation  Master 
Plan 

TET 

Technical  Evaluation  Team 

TM 

Test  Modules 

TM 

Technical  Manuals 

TMDE 

Test  Measurement  and 
Diagnostic  Equipment 

TMP 

Test  and  Maintenance 
Processor 

TO 

Technical  Orders 

TPS 

Test  Program  Sat 

TPWG 

Test  Plan  Working  Group 

TQM 

Total  Quality  Management 

TFO 

Test  Requirements 
Document 

TRR 

Test  Readiness  Review 

TSMD 

Time  Stress  Measurement 
Device 

TTL 

Transistor>Transistor  Logic 

UHF 

Ultra  High  Frequency 

ULSI 

Ultra  Large  Scale 

Integration 

UMF 

Universal  Matched  Filter 

UUT 

Unit  Under  Test 

UVPROM 

Ultra-Violet  Programmable 
Read  Only  Memory 

V 

Volt 

VCP 

Very  High  Speed  Integrated 
Circuit  ^mmunicat'ons 
Processor 

VHDL 

Very  High  Speed  Integrated 
Circuit  Hardware 

Description  Language 

vmsic 

Very  High  Speed  Integrated 
Circuit 

VIM 

Very  High  Speed  Integratec 
Circuit  Insertion  Module 

VLSI 

Very  Large  Scale 

Integration 

VSM 

Very  High  Speed  Integrated 
Circuit  Submicron 

VSP 

Variable  Site  Parameters 

VTB 

Very  High  Speed  Integrated 
Circuit  Technology 
Brassboard 
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WAM 

Window  Addressable 
Memory 

WBS 

Work  Breakdown  Structure 

WRSK 

War  Readiness  Spares  Kit 

WSI 

Wafer-Scale  Integration 

WSIC 

Wafer-Scale  Integrated 
Circuit 

X 

Reactance 

XCVR 

Transceiver 

Y 

Admittance 

z 

Impedance 

ZIP 

Zero  Insertion  Force 
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